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ABSTRACT 

A study of computer-assisted instruction (CAI) for OS 
Army basic electronics training at the US Army Signal Center and 
School establishes the feasibility of CAI as a training technique. 
Three aspects of CAI are considered: effectiveness* efficiency* and 
applicability of CAI to basic electronics training. The study 
explores the effectiveness of the learning achieved by the student 
and the time required to complete the course material. An analysis of 
current training costs compared to estimates of CAI costs is used to 
establish the efficiency of a CAI training system. Computer-assisted 
instruction is shown to be applicable to Army training methods and 
educational strategies as well as to new communication and 
electronics equipment maintenance training. (Author) 



A FEASIBILITY STUDY OF COMPUTER ASSISTED INSTRUCTION 
IN US ARMY BASIC ELECTRONICS TRAINING 



FINAL REPORT 



Prepared for 

US CONTINENTAL ARMY COMMAND 
FORT MONROE, VIRGINIA 
AT THE 

US ARMY SIGNAL CENTER AND SCHOOL 
FORT MONMOUTH, NEW JERSEY 



US OCPAllTMiNTOFHiALTH. 
i0UCATI0N4WiLFAffi 
NATIONAL INSTITUTi OF 
tOUCATION 

THIS OOCUMCNT HAS BEEN REPRO 
OUCEO EXACTLY AS RECEIVED »=BOM 
The person or OROANIZATIONORIGIN 
ATrNG lT POINTS OP VIEW OR OPINIONS 
STATED 00 NOT NECESSARILY REPRE 
SENTDFFICIAL NATIONAL INSTITUTEOF 
EDUCATION POSITION OR POLICY 



. . . The findings in this report are not to be construed as 
an official Department of the Army position, unless 
so designated by other authorized documents. • • • 

• . .Although this document contains no classified infor- 
mation it has not been cleared for open publication 
by the Department of the Army^ Reproduction, 
wholly or in part, is prohibited without the prior 
approval of the Department of the Army. • . • 



CONTRACT NR DAAB D7-67-C-.0578 
INTERNATIONAL BUSINESS MACHINES CORP. 
FEDERAL SYSTEMS DIVISION 
GAITHERSBURG, MARYLAND 



February 1968 



FOREWORD 



The Department of Defense has called for deiaonstration of the gains 
that can be achieved in military training through application of the most 
advanced concept's and techniques extant in education and industry. This 
study represents an initial step in a pioneering effort to meet this 
challenge through user development of Computer Assisted Instruction in 
the electronics training program of the US Army* 

The demonstration in this study of the capalili'.ty of Conputer^s sifted 

ject matter as well as and in lea 



Instruction to teach basic el ectronics subje 



aa 



time than conventional training are results of major significance for 



military training. 

Conduct of the pioneering work reported on the following pages required 
the contribution of foresight and effort by many persons. Special thanks 
arc due members of the Project Review Cotnoiittee who provided importaAt 
guidance for the conduct of the study. The members included: Captain 
Charles Blaschke (Office of the Secretary of Defense, Manpower); Dr. Charles 
Hersh (Office of the Deputy Chief of Staff for Personnel, Department of the 
Army); Mr. Harold Schulz and Mr, Walter McDowell (U. S. Continental Army 
CoDsnand) . 

The members of the IBM Federal Systems Division, under the leadership 
of Dr. Stanley Winkler, who prepared the instructional materials used in 
the feasibility study and performed the analysis reported in the body of 
this report, deserve full credit for the quality of their effort. 

The United States Continental Army Conmand (Jon^uter Assisted Instruc- 
tion Project Group at the US Army Signal Center and School played a key 
role in designing the feasibility study and managing its performance. 
Special acknowledgement must be made of the devoted efforts contributed to 
this work by Colonel Walter Runte, Project Manager, and Dr. Vincent Cicri, 
Technical Director, and by the members of their staff. 

Participation of the US Army Signal Center and School in this study 
has been a very rewarding experience. The experience our staff has had 
to become familiar with the instructional uses of the computer serves as 
a firm foundation for the further development of Computer Assisted Instruc* 
tion in electronics training. 



Brigadier General^ 
Conmand ing General 
US Army Signal Center & School 
Fort Monmouth I N« J« 
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ABSTRACT 



A study of Computer Assisted Instruction (CAI) for US 
Army Basic Electronics Training at the US Army Signal Cen- 
ter and School establishes the feasibility of CAI as a training 
technique. 

Three aspects of CAI are considered: effectiveness, 
efficiency and applicability of CAI to Basic Electronics I^ain« 
ing. 

The study explores the effectiveness of the learning 
achieved by the student and the time required to complete the 
course material. 

An analysis of current training costs compared to esti* 
mates of CAI costs is used to establish efficiency of a CAI 
training system. 

Computer Assisted Instruction is shosvn to be applicable 
to Army training methods and educational stra]tegies as well 
a^ to new Communications ^Electronics Equipment Maintenance 
Training.' 

The evidence developed during this study, the first of its 
kind at an Army service school and initiated to assist USCONARC 
in determining the feasibility of using CAI for electronics train^ 
ing, has demonstrated that CAI is effective and efficient as an 
instructional method. It is applicable to electronics training 
at the US Army Signal Center and School in particular and by 
extrapolation to Army training in general. 




SUMMARY OF RESULTS AND CONCLUSIONS 



The study demonstrates and this report presents evidence for the 
feasibility of using Computer Assisted Instruction (CAI) as an instructional 
method to teach Basic Electronics which is effective, efficient, and appli- 
cable to training at the United States Army Signal Center and School and 
by implication to Army training in general. There are three aspects to 
the concept of feasibility: the learning achieved by the student, the time 
required to complete the course, and the cos.t^. 

The study consisted of five general tasks. The first included an evalua- 
tion of the training effectiveness of CAI compared to conventional instruction. 
This evaluation was performed by means of a comparative experiment which 
measured student learning and course completion time. As a second task, 
the experiment required the development of a brief CAI course. The third 
task was the comparison of cost effectiveness between CAI and on-going 
instruction. The remaining two tasks were the determination of the instruc- 
tional factors and processes associated with CAI, and a review of the state- 
of-the-art in CAI as related to USASCS requirements. 

To demonstrate feasibility, a course covering two days of instruction 
and consisting of 15 classroom periods of 11 hours and 15 minutes was 
developed and converted for implementation on the IBM 1500 Instructional 
System. 

The evidence for the effectiveness of this implementation was based on 
empirical data collected under a controlled experiment which compared CAI 
with two types of conventional training methods currently in use at the USASCS, 

From three incoming training groups of approximately 150 students a 
sample of 54 students in Basic Electronics Training was chosen to obtain 
18 students in three aptitude levels. The students in each aptitude level were 
equally divided and randomly assigned to one of the three instructional modes: 
Instructor Controlled (IC), Television Controlled (TV), and Computer Assisted 
Instruction (CAI). 
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Based on the criterion measure, there was no significant 
difference between instructional methods. Significant differ- 
ences were found in performance among students of different 
aptitude levels. 

The mean time required to complete the CAI course was 
about ll7o less than the fixed time tor instructor-controlled 
and television- controlled instruction when all aptitude levels 
were included. High level students averaged 49% faster, 
medium level students averaged 17% faster, and low level 

students averaged 32% slower than those taught by conven- 
tional methods. 



A comparison of CAI training costs with conventional training costs at 
the U^S* Army Signal Center and School was made by calculating the train- 
ing costs on a cost-per-student-hour basis* The significant variables included 
in the CAI student hour costs were hardware costs, amortization schedules, 
daily system usage rates, and potential savings in student training time* 
Depending on system usage, depreciation policy and student selection practices, 
CAI costs are competitive with conventional training costs* 

The applicability of CAI to USASCS training requirements in particular 
and Army training requirements in general'was explored* The fact that a 
portion of the Basic Electronics Training at USASCS was effectively imple- 
mented indicates the applicability of CAI* Furthermore, the study showed 
that a high proportion of the current USASCS training is adaptable to CAI, 
that CAI state-of-the-art systems are commercially available, and that 
USASCS and Army training practices are currently being implemented by 
various CAI users* 

In conclusion, th6 study showed that CAI is: 



Effective - 



Efficient - 



Applicable - 



based on performance data, it was demonstrated 
that CAI was effective as training \na, TV and IC 
and reduced training time by 11%* 

jider favorable decisions concerning amortization 
and system usage, CAI becomes cost-competitive 
with conventional training* 

a significant portion of existing USASCS courses is 
adaptable to CAI, state-of-the-art CAI systems 
are available, and implementation of present USASCS 
instructional practices have been adapted to CAI as 
cited in the publishiad .Uteratiire* 



Based on the above criteria of effectiveness, efficiency, and applicability, 
the results of this study can be used to conclude that it is feasible to use CAI 
as an instructional method in Army training. 
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Section 1 



INTRODUCTION 

The overall objective of this study was to provide for the United 
States Continental Army Command (USCONARC) the objective evidence 
to be used in determining the feasibility of Computer Assisted Irtst»uction 
(GAD as a medium in teaching courses in Basic Electronics. The approach 
employed was to assess CAI in terms of its effectiveness as a teaching, 
method, its relativ efficiency compared with the alternatives currently 
in use, and its applicability to the training requirements of USCONARC. 

In June, 1967, the United States Army Signal Center and School 
(USASCS), under the direction of USCONARC, awarded a six-month 
contract to the Federal Systems Division of the IBM Corporation for the 
.conduct of this study. The products of the study were to provide empirical ' 
data on the effectiveness of an actual CAI implementation using students 
taken from the normal population of students obtaining Basic Electronic 
training at USASCS and to provide detailed information and guidelines 
which would be useful to USCONARC in determining the desirability of - 
proceeding with the USCONARC Technical Development Plan (TDP) 
. entitled "Computer Assisted Instruction in Electronics Training," dated 
12 August 1966. 

To assess the effectiveness of CAI as an instructional method, it 
was necessary, first of all, to implement a portion of the Basic Electronics 
training on a CAI system. The course segment selected was the material 
taught on Thursday and Friday of the first week in the Common Subjects 
Branch. It includes the material in the lesson plan set 280. 0*-l-LP(25-38), 
dated January 1967, under the following titles: 

a. Introduction to E'lectricity (280. 0-l-LP(25-27) 

b. Care and Use of the Multimeter (280. 0-l-LP(28-3l) 

c. Batteries (280. 0-l-LP(32-34) 

d. Resistors (280. 0-l-LP(35) 

e. Resistor Applications (280. 0-l-LP(36-38) 
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The selection of this material was based on several considerations. 
As a part of the first two weeks of instruction, the material is taught to 
all students preparing for a Military Occupational Specialty (MOS) in the 
school, thereby offering a large population from which to draw a student 
sample. The material includes definitions, terminology and concepts 
basic to any further wo;, k in the school. The material is not dependent upon 
previous training and thus teaches students not affected by the instructional 
methods currently employed. 

The CAI course was developed for presentation on the IBM 1500 
Instructional System. The student station for this presentation consisted 
of an IBM 1510 Display Console (cathode ray tube CRT, light pen and keyboard) 
and an IBM 1512 Image Projector for colored graphic presentations. 

It was decided that the effectiveness of this implementation should 
be compared with two methods of conve^itional instruction, Television- 
Controlled (TV) and Instructor -Cootrolled (IC). To be sure that only the 
mode of presentation would vary, the CAI course was developed to meet 
the same course performance objectives used by the other two method*. 

For the comparison, a number of other controls were implemented 
to ensure the objectivity of the conclusions. A sample of 54 students 
was selected from the total population of USASCS students to represent 
the range of aptitudes found at the Signal School. Equivalent groups of 
18 students were assigned to each of the three instructional methods. 
The effectiveness of instruction by each of these methods was measured 
by an 85 -item multiple choice paper and pencil test developed from the 
course performance objectives. In addition, the time required by the CAI 
students to complete the course was compared with the fixed time required 
for the students taught by the conventional methods as established by the 
lesson plans. 

The implementation of the course materials and the results of the 
comparison of effectiveness provide evidence to USCONARC that CAI is 
an effective method of teaching Basic Electronics. Of necessity, this 
study effort was limited. Time constraints allowed for the implementation 
of only a small segment of the Basic .Electronics course, and only a small 
number of students could be used to evaluate the implementation. 

As a demonsti tion of the efficiency of CAI, a cost analysis was 
conducted. The cost of current training at USASCS was compared with 
the estimated cost of a CAI instructional system. It would be naive to 
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ovpoct that, in its current state of development, CAI could be shown to 
have a cost advantage over an established training organization. On the 
other hand, if CAI, in fact, is so expensive that future developments 
could not be expected to make the method cost-competitive, then it 
\\ould be undesirable to undertake a major CAI effort. The purpose of 
the cost study was to identify those elements of CAI which are signifi- 
cant in cost and to evaluate their effect on the cost model. For com- 
parison, the current training costs at USASCS were calculated, based 
on data supplied by the Signal School. Costs were distributed to a 
student-hour of instruction. CAI costs were calculated as well as possible 
with the data available, and comparisons made for various decisions on 
amortization, depreciation, and distribution as well as the effect of system 
utilization and possible savings in training time. 

Finally, the task of demonstrating that CAI is applicable to the 
training requirements of USASCS in particular and the Army in general 
was addressed. Obviously, the effective implementation of a portion of 
a USASCS training course was a first step in this demonstration. In 
addition, the resource requirements needed by USASCS to begin imple- 
mentation of the USCONARC TDP are identified. A general hardware 
configuration is described, and the number and type of personnel 
required to implement and maintain instructional materials and to operate 
the system equipment are listed. Three commercial CAI systems 
currently available for delivery are described. It is noted that these 
systems would meet the hardware requirements which had been outlined. 
Two courses, one representative of Basic Electronics training and one 
representative of New Equipment IVaining, were analyzed to determine 
the methods of instruction currently in use. Based on this analysis and 
experience in implementing CAI, the proportion of existing courses 
which could be converted to CAI was estimated. 

Consideration was also given tothe identification of instructional 
factors and processes relevant to CAI in Basic Electronics training. It 
was admitted that no instructional methodology can over completely 
replace the unique capabilities of the human instructor. Even the 
V(!rsatility of CAI, though remarkably adaptive, has practical limitations 
anci will fail to be all things to all students. By using CAI, however, 
many of the instructional practices which currently cons\ime substantial 
amounts of the instructor's time can be handled on the system, freeing 
lUf^ instructor to attend to individual student problems. Furthermore, CAI 
provides individually paced instruction and student administrative data used 
in course management. Three general categories of these practices were 
identified and examples of how they are being handled by CAI in other 
institutions presented and referenced to Army requirements. 
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In flummary, this study was designed to produce evidence of the 
effectiveness, efficiency and applicability of Computer ..{^.ssisted 
Instruction for training students in Basic Electronics. Each of the three 
following parts of this report presents, in detail, the procedures, results 
and conclusions of this study as they apply to the effectiveness, efficiency, 
and applicability of CAI. 
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Section 2 



EFFECTIVENESvS OF COMPUTER ASSLSTED INSTRUCTION 

This portion of the study was designed to assess the effectiveness 
of Computer Assisted Instruction as a traininjj; method. Specifically, 
the question addressed was whether or not CAI could be used to teach a 
portion of the Basic Electronics course in the Common Subjects Branch 
of USASCS. The instructional material selected was described in the 
introduction to the report. 

Six tasks were required to produce an objective evaluation of the 
effectiveness of CAI. First, it was necessary to implement the course 
material on the IBM 1500 Instructional System. Since the effectiveness 
and, to some extent, the efficiency of CAI was to be measured by this 
implementation, these factors had to be considered in designing the course 
logic* Because of the limited time for the implementation, it was neces- 
sary to evolve efficient implementation procedures. Second, the decision 
to compare CAI effectiveness with two modes of conventional instruction 
(TV and IC) required that the methods had to be defined and the course 
^ content under each method made equivalent. Third, a device t3o aieasure 
the student^s performance as a result of this instruction had to be devised 
with due consideration to the problems of reliability and validity. Fourth, 
it was necessary to define the student population in terms of aptitude and 
to evolve a sampling procedure which would produce a sample of students 
representing the range of aptitude of USASCS. Fifth, a detailed procedure 
for administering the training under the three instructional methods was 
required. Finally, the data from the performance measure had to be 
analyzed and interpreted. 

This part of the report describes the procedures that were followed 
to accomplish each of these tasks and the results that were obtained. The 
implications of these results in terms of the effectiveness of CAI as an 
instructional method are discussed. 
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2. 1 COURSE DEVELOPMENT 



The material used for this study was identified in the introduction 
to the report. The material was selected by joint agreement between 
USASCS and IBM Federal Systems Division. Since the IBM 1500 Instruc- 
tional System was designed specifically fcr CAI it was agreed that this 
system would be made available for use in the study. Figure 2-1 illus- 
trates the student station of the 1500 System. 

Special attention was given to eusurethat the CAI course material 
was similar in content to the material presented in the instructor - 
controlled and television-controlled classrooms. Three steps were taken 
to assure equality of subject coverage. IBM personnel were provided 
with complete lesson plans and other relevant instructional material; 
they were also given the opportunity to observe the conventional instruc- 
tion in the classroom. Secondly, the terminal performance objectives 
for the material were provided for IBM. Finally, the CAI course lettont 
were reviewed by Signal School personnel for equivalence and accuracy. 

The development of the course material was begun by organizing 
the material into subject matter areas called course segments. The CAI 
course segment consisted of a pretest and a series of lessons. The piie- 
test was provided to determine the amount of information which the studedt 
brought to the training situation. Following the pretest, a series of 
lessons presented the new material. Each of the lessons concluded by a 
lesson test and if necessary additional summary material. 

The structure of the course can be outlined as follows: 

Segment I Introduction to Electricity 

Lesson 1. Use and purpose 

Lesson 2. Survey 
Practical Exercise -Surv6y 

Lesson 3. Electron Theory 

Lesson 4. Voltage 

Lesson 5. Resistance 

Lesson 6. Current 



id 
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Segment II Multimeter TS-352/U 

Lesson 1. Introduction 
Lesson 2. DC Voltage 
Practical Exercise -DC Voltage, 
Lesson 3. AC Voltage 
Lesson 4. DC Current 

Segment in Batteries 

Lesson K. Introduction 

Lesson 2* Series Connection 

Lesson 3» Parallel Connection 

Lesson 4. Series - Parallel Connection 

Segment IV Resistors 

Lesson K Introduction 

Lesson 2* Color Code * 
Lesson 3» Ohmmeter 

Practical Exercise -Batteries /Ohmmeter 

A student *s path through the course was determined by his perfor-t 
mance on the pretest and lesson tests. The pretest was used to improve 
the efficiency of the instruction. Since the pretest consisted of groups of 
questions related to the lessons that followed, the student's performance 
on the pretest was used to present to him only that material which he 
required. If* in the pretest, the student demonstrated proficiency with 
the various skills or concepts taught in the segment, he skipped the 
lessons covering those skills and concepts. When, however, he failed 
a group of pretest questions, he branched to the appropriate lesson and 
continued to the end of that course segment* 

The lesson test was used to improve the effectiveness of instruc- 
tion. Following the instructional material, the student was presented 
with the opportunity to demonstrate that he had learned the material. 
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BEST COPY AVAIUU^LE 



I. t*u' ./..St r let i(» -a! i^iati-rial had n^t Uov\^ c\\\ct\\'c in fi^achini: the skills 
arif! cortcrpf^ '\v voci\xirv<K tho .^tiiciiMU uas proftt^nted with roviows and 
summaries to as.sist him. In no caso was tho student allowed to proceed 
until he had given the rt^quirod response to tho lesson test questions. 

In spit^' oTthe tim(* restrictions imposed by a six month feasibility 
study, several unique features were included in the course strateuies to 
indicate the adaptability oi CAI to various training requirements. Of 
orii^nary importance was the devclooment of practical exercises which 
became an integral part of the CAI training. At threc^ifferent points 
in the short training course the student actually manipulated electronic 
C(mir)onents and equipment under the guidance of the CAI system. As an 
t'\an: e, when learning about resistors, the student actiially measured 
r'^sistor values using Multimeter TS - 352/U. He entered his obtained 
rf*adirigs Into the system, where they were evaluated. If his responses 
r*[r] not indicate that he had reached the desired proficiency, he was given 
dditional guidance and practice. 

To maintain student interest, the mode of presentation of the course 
.n:^aterial was varied. One of the most unique variations was the use of 
animation on the CRT. ^hen learning about the attraction and repulsion 
ot chari^ed bodies, the student was presented with an animated demon- 
stration that like charges repel and unlike charges attract. To provide 
the student with reference material when he needed it, a glossary was 
implemented. If the student was unsure of the meaning of a technical 
term, he could request the glossary and ask for a definition of that word. 
He was given the definition and then returned to the instructional material. 
To emphasize technical terms and assist the student in learning them, 
such terms were often underlined or caused to blink on and off on the 
CRT when they were first presented. 

No claim is made that the strategies and technique used in this 
implementation were ontimal nor that thev fully exoloited the potential 
>f CAI. However, within the time and resource limitations of this feasi- 
bility study, th*^y ;\nswered the requirements of effectiveness and cffi- 
iency and gave some indication of the wide applicability of CAI to 
'h»ctrc, lie training. Appendix A presents a detailed description of the 
•ir )^**dures employed in develooiniz the course and a complete documen- 
tnt^on o! the resultant course (pace A- I if. ). 



2. 2 THE INSTRUCTIONAL METHODS 



The independent variable of primary interest in assessing the 
effectiveness of the CAI course was the method of instruction. Three 
methods were compared: Television-Controlled (TV), Instructor- 
Controlled (IC), and Computer Assisted (CAI). Television-Controlled 
instruction was defined as the method of instruction currently in use in 
the Common Subjects Branch of the School. It included the use of video- 
taped presentations, programmed instruction, practical exercises, and 
conference time. The Instructor-Controlled Instruction was similar to 
the Television-Controlled, with a change of emphasis from video tape to 
conference time (Table 2-1). 

Table 2-1 

COMPARISON OF TV AND IC INSTRUCTIONAL METHODS 



% of Total Time 



Media 


TV 


IC 


Television 


38 


20 


Programmed Instruction 


21 


21 


Conference 


9 


27 


Practical Exercise 


32 


32 




100 


100 



CAI was defined as an implementation, using the IBM 1500 Instruc- 
tional System, of the same course material on a computer -controlled 
system. 

Within each of the three instructional methods, the actual course 
content remained constant relative to the list of course objectives* The 
order and details of presentation varied somewhat from method to method. 

Since the TV and IC methods depended on the skill of the instnictors 
used in the classroom, it was necessary to control this skill factor tr 
avoid a differential effect between the two methods. Two pairs of instruc- 
tors were selected from among those considered to be above averaj^e. 
Thus the CAI method could be compared with the other two methods at 
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their bo;U. in':] ai^y a^lv j *H:i which nr.<;.lit accTue to tho C";AI method 
v^ould be valid I'or rini-j.-jMai sitna.ticp. in which ^vcraj^o instructors 
are used. 

The raatchii^i: i.^rr^c r o uay backed on subjective aLir(;oniont aniony 
USASCS personnel ironi the i:Jvaluotion Division, the Instructional Methods 
Division (3MD). and pe-^.'-cnnel from IBM who reviewed the rating cards 
ot those insr,ruci:c>rs av.ii!r;hle [or the sludv. The instructors were matched, 
as closely as possii.l^\ {\\(* basis of formal eduCe^liO]], teaching experi- 
ence, 'grades in the Instructor Tra^ninv^ Branch, IMD, and subsequent 
ratings as instructors. 

It would have been more desirable to ait<*mpt to obiectivoly mea- 
sure instructor skilL HcAvevcr, within the time available, such an 
approach was not feasible and the procedure actually used was adopted 
as the most practical altc:rnative, 

2.3 MEASURES OF EFFtCCTIVEiNESS 

The main measiire of effectiveness of the instructional methods 
was a score on the criterion measure. Ideally, the effectiveness of 
training <^hould be based oa some measure of job performance. However, 
when, as in the present case, the training is remote in time from an 
opportunity to measure job performance, an alternative procedure must 
be developed. The alternative for this study was to develop n 85 item 
4-alternative muJtiple-choice criterion measure based on detailed behav- 
ioral objectives of the course material selected, 

3. 1 Criterion Measure 

An oriainal draft of 130 items, d^:iVeloped from the lesson plans, 
was administered to 207 students who had just completed their first week 
of training at the School. Item selection was based on these data. Two 
measures were computed for each item — a difficulty level, which was the 
percentage of students anFworinj4 the item correctly; and a discrimina- 
tion index, which was a rr^asure of how well the item discriminated 
between, the upper and IcAver 27% of the sample. 

Items :*or the {:no] draft were selected first on the basis of difficulty 
level. Where ^ues^^inu by the student has no effect, a difficulty level oi 
. 50 maximallv discrinnnates among the students. In a 4 -alternative 
muUinl c -choice item.. ^uo.^sinj4 does h^vc an effect and the difficulty 
level must be raised to correct for it. Therefore, a difficulty level of 
. 65 was chosen as t:ho di\sircd average difficulty for the items. 
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Those items selected on the basis of difficalty level were further 
selected on the discrimination index. An index of . ?,0 was chosen as the 
minimum value which indicated any discrimination in performance 
between the upper and lower groups. These values were used as guide- 
lines rather than absolute limits, and some items were included which 
did not meet these criteria. Some items which were quite easy (difficulty 
.95) and some items which were quite difficult (difficulty . 14) but had 
little discrimination were included, to ensure that the test extended 
beyond the capabilities of the students in both directions. 

The second draft of the criterion measure contained 85 items. 
These items covered definitions and concepts as well as perfornnance 
measures, such as reading resistor color codes, reading scales on the 
multimeter, and recognizing schematic synnbols and simple battery cir- 
cuits. There were nineteen items on each of the four major segments 
of the course material and nine items covering the conversion of units, 
a total of 85. 

The criterion measure was evaluated in terms of validity and reli- 
ability. Validity refers to the test measuring. what it is supposed to 
measure. Without an objective measure of validity, the approach was 
to ensure that the criterion test measured as much as possible the 
students* knowledge of the course material. To this end, each item was 
referenced to one or more of the course objectives. As a precaution against 
possible bias, the final draft was submitted to the Department of Specialist 
Training, USASCS, for review. When their minor revisions were included, 
the Department of Specialist Training concurred with the measure. While 
this validation procedure is based on subjective agreement, it was felt 
that it produced an appropriate and impartial measuring device. 

The reliability of a measuring instrument refers to the consistency 
of the measurement. Every measurement contains some error, and its 
magnitude shotild be assessed. In educational measurement it is not 
possible to measure error directly, but methods are available by which 
it can be estimated. A widely used procedure (split-half method) is to 
divide the measuring device into two halves, calculate a score for each 
student on each half, arid compute the correlation between the two sets 
of scores, A second method (Kuder -Richardson) is based on item statis- 
tics and is not dependent on any particular subdivision of the measuring 
device. A reliability coefficient of .80 is generally accepted as an indi- 
cation of satisfactory reliability* It indicates that the variance due to 
error is one-fourth as large as the true variance of the scores. 
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'1 fu* it: li ' I '.' <' r\' ^' :.;ra.:Mro ir : ; i ri i sio rod to 95 

studerts who • ist , ; ^/i d r -'^/d iheir lirst vvctik ot training at the ochooU 

The split-halx rt: Si ) hdity 0 t».S'» data vvris ,'^0, and the Kuder- 

Richiardson rtdia!)i!i*x w.s ,^V. hO:!- f.OL-flii'i ents indicated acceptable 
reliability. 1 no » rii^^e ''iffL^uMy !e\td of the i^^t^nis was . u7. 

2. 3* Z Stu.-'f^Tf T/rd' inj Tirv.t/ 

A set'oiic: . ^ - : - oi th»» c 1 ri -cti ^»nes s of v .rairdng methods w. s 
the length of tinu* i^ t(>Mk Inn .-.-tudcnts to complete the course. Since 
training time has n fliror.^ bearing on fhe efficiency of an instructional 
method, this variabic- \'/as of particular interest in the feajjibility study. 
The Television-Controlled and the Instructor-Controlled methods each 
required 11 hionrs and IS n^inutes, as set by the lesson plans referenced 
in the Introduction. It was estimated that a student would require a mini- 
niuin of two ard one haP* hours to complete the CAI course. Since the 
actual amount of time spent on the course material with the CAI system 
was essentially student controlled, there was no maximum time for this 
method. The time measure used in the CAI method was the actual time 
used by the student at the terminal. This information was available as 
part of the software support for the system and appears in the student 
records. 

To obtain a precise comparison betv/een the times of the instruc- 
tional methods, only tfiat tiirie actually spent on instruction was considered. 
Thus time tor roll call, touting, administrative procedures, etc., was 
excluded from the time data.. 

The distributions of tirnes in the CAI i^iethod was not completely a 
function of the student control. In ad<'lition to the minimum time imposed 
by the course looic, tne uarticular implementation used for this study 
placed constrainf:s on the shape o^* tiie distribution of student time. However, 
within these constraints, thf times did vary from student to student, and the 
time measurements provid<.;d useful data. 

2.4 THE STUDENT SAMPLE 

A total of 54 students was used in tins study, 18 fur each of the 
three inst ruct onal ri.ethorls. All of the students were selected from the 
normal inputs of draftpoo and Reiyuiar Arnw students to the Common Subjects 
Branch with the exception of. turnhaci<s and students in the 41 series MOS^s. 
The turnbacks v.err^ excluder! !-iecause of the complications involved in using 
students vwvj bar! previous traininu at tho school and who had also once failed 
the material. Thr -M st^rit^s MO.-'s entering the Common Subjects Branch 
were cxclufird bocJu.-<* thr»sr students are not selected by Electronics Area 
Aptitude- :ii:nvr (EL ^u:ore). 



2,4, 1 Aptitude Levels 



The students used in the study were selected by means of a strati- 
fied random sampling procedure to represent three levels of aptitude — 
low, medium, and high. Student aptitude was measured by a predicted 
USASCS Phase I test score. The Phase I test mentioned in this report 
is given the student at the end of the second week of training in the 
Common Subjects Branch of the' Radar Division in the Department of 
Specialist Training. The prediction was based on a linear combination 
of four of the subtest scores from the Army Classification Battery (ACE). 
The equation used to predict the Phase I test score was generated by a 
multiple linear regression procedure. This procedure produces the 
linear equation which is the best predictor because errors of prediction 
are minimal. An initial equation is calculated, using the independent 
variable having the highest correlation with the dependent variable. 
With this equation, the residuals, i.e., the differences between the 
actual and predicted Phase I scores, are calculated. A second equation 
is generated using the first independent variable and adding a second 
independent variable which has a high relation with the residuals. This 
process is continued until all the variables are used. 

Applying this procedure to a sample of approximately 1000 students 
at USASCS produced an equation containing four independent variables 
and the appropriate weightings to be applied to each. The addition of 
more variables to the equation did not improve the accuracy of prediction. 
The predicted Phase I scores correlated . 66 with the actual scores. This 
correlation indicates that approximately 44% of the variance in the Phase 
I test scores is accounted for by the ACB scores used. The final equation 
was: 



Y = . 34ELI + .31AR + . 18PA + .05ARC - 1.23, where: 

Y is the predicted Phase I score, 

ELI is the score on the Electronics Information subtest, 
AR is the score on the Arithmetic Reasoning subtest, 
PA is the score on the Pattern Analysis subtest, 
ARC is the score on the Army Radio Code subtest. 
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Durinc each of the weeks the study was run. : election scores were 
calcxilated for the entire student population enfcerin;^ common subjects 
with the exceptions noted above. The distribution of selection scores 
was divided into five f;ronp^ as follows: 

Group I, low aptitude, scores of 35 or less 
Group II, i^cores of 86 to 100 

Group III, middJe aptitude, scores of lOi i^. 103 
Group IV» scores of 104 to 116^ 

Group V, high aptitude, scores of 117 or more 

2 Sampling Plan 

A minimvim of eight students each was randomly selected to repre- 
sent Grovips I, III, and V. Half of the students from each group were 
randomly assigned to the TV class and the other half to the IC class. 
The remainder of the two classes was filled at the convenience of the 
registrar. The CAI students were taken from the TV and IC classes. 
In each of the two classes, one student from eabh aptitude level was 
selected at random for training with CAI. Thus, three students from ^ 
the TV class, one at each aptitude level, and three from the IC class, 
one at each aptitude level, constituted the CAI group during each week 
of the study. Three students, one at each aptitude level, in each class 
were selected as alternates. This procedure was replicated for three 
y eeks. The total sample of 54 students consisted of 18 from each aptitude 
level, evenly divided among the instructional methods. A diagram of the 
overall aesign is shown in Table 2-2. Descriptive data on the student 
•ample ii presented in Table 2-3. 



Table 2-2 
EXPERIMENTAL DESIGN 



Aptitude Levels 




Instructional Methods 






CAI 


TV 


IC 




High 


6 


(> 


6 


18 


Medium 


6 


6 


6 


18 


Low 


6 


6 


6 


18 


N 


18 


18 


18 


54 
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fi£ST COPY mmiE 



On M*' . : ./ '-iix"^ wf^ck ihv'it iht.* .study wa::? tmp, iVj* st'lcu tion procc- 
aurf Jes^' ri.>i:?<'l ah^vo i ^jirricd inii. and two rustors \vei*e constructed. 
The rt)stcr- li:;tcr.i tht>sc w^/rsc^ns who were to he placed in ihe TV and IC 
c.lasst.'S. Ihf cldsscs a.i constilutod by \hc USASCS Registrar wore held 
intact thrnM.i;h Tiu.'ir'dd^^ ^v.n.'A so that orientation could proceed hy IvlOS. 
At th completion of o ? cntaf-uut the necessary shifts in student personnel 
were comp^^^j^i -o ;/l:iC'^ ilio seh. cted students m the proper classes, 

A', tne conij!lci!on of instruction on Tuesday afterncjon, the criterion 
nieaburc v/a5 nresented c.s a pretest to oach class us»*d in the study. None 
of the courb . iriatcriai selected Tor the study was presented to the students 
on Monday or Tuesday. Therelore, the scores on this pretest represented 
that inforn\afion wliich the student had before the start of instruction* 

Following class on Wednesday, the CAI students were transported 
to Annapolis, Maryland. That evening they were instructed in the use of 
the student terminal and allowed approximately 15-20 minutes to familiarize 
themselves with the various features and procedures. 

On Thursday and Friday, the CAI students used the student stations 
to learn the course material. Initially the students were divided into 
two groups of three students, one from each aptitude leveL The first 
group used the tertninals from 8 to 12 in the morning and 4 to 8 in the 
evening- The second group used the terminals from 12 Lo 4 in the after- 
noon and 8 to 12 at night. On Friday, adjustments were made in the 
schedule to put those students who were progressing more slowly on 
the termini's in place of those who had completed the work. 

For the second and third weeks, the schedule was altered so that 
the first group used the terminals from 8 to 12 and 5 to 8. The second 
group used the terminals from 12 to 5 and 8 to 10. On the second day 
the same fiexibiliiy was used. The reason for the change in scheduling 
was the ^observation during the first week that the second group of stu- 
dents was tiring in the evening and that possibly time was not being 
used proriuctively. 

The students proceded at their own rate because presentation of 
material was under their control. A proctor was present in the terminal 
room assist the students if necessary. His actions and procedures 
were determined by the proctor instructions which are appended to this 
report (Appendix B). In actuality, his communications with the 
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students were generally in an administrative capacity and he made few, 
if any, inputs to the instructional process. All contacts and observations 
made by the proctors were entered on a log. A sample of the proctor 
log is shown onAppendix B-13 . When the student completed the course 
material, he was given the criterion measure as a post teat. The students 
were returned to Fort Monmouth on Saturday and rejoined their classes 
on Monday morning. 

The non-CAI students followed the normal class on Thursday and 
Friday. Immediately following the end of instruction on Friday, the 
criterion mea9ure was administered to the two classes as a post test, 

2. 6 RESULTS AND ANALYSES 



At the outset it was necessary to determine if the students in the 
three instructional methods began the instruction with the same amount 
of prior knowledge of the course material. The three groups were com- 
pared using the pretest scores as a measure of the prior knowledge. 
The summary data is presented in Table 2-4. 

Table 2-4 

SUMMARY OF PRETEST DATA 



METHOD 


MEAN 


S.D. 


APTITUDE LEVEL 


MEAN 


S.D. 


TV 


32.4 


12. 8 


High 


49.1 


10. 3 


IC 


33. 9 


14. 8 


Medium 


30. 0 


10.2 


CAI 


37. 0 


14.1 


Low 


24. 3 


4.9 


TOTAL 


34. 5 


13. 8 









To evaluate the significance of the observed differences among the 
means, the analysis of variance procedure was used (Cochran and Cox, 
1957; Lindquist, 1953). This analysis compares the observed differences 
among the means with the variance of the total sample corrected for the 
effects of instructional method and aptitude level. The statistic used is 
the F ratio with which the probability ot obtaining a given result from 
chance alone can be determined. The results of this analysis are given 
in Table 2-5. 
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Tabu? Z- ^ 
ANALYSIS OF PRETEST DATA 



SOURCE 



d. f. 



MEAN SQUARE F RATIO p 



Instructional Mttlhod 



Aptitude Level 



IM X AL 



Residual 



TOTAL 



4 

53 



3044. 0?. 



39.80 



I. 19 n. 3. 



37.49 .001 



0.49 n. s. 



81. 20 



d. f . = degrees of freedom 
n. s. = not significant 
p = probability 

The right column in Table 2-5 gives the probability of obtaining 
differences as large as those observed by chance alone. The notation 
"n. s. " indicates that the differences observed do not approach the usual 
5% or one chance in 20 probability level. Thus, the differences observed 
•among the scores of the students assigned to the instructional methods 
are considered to be merely chance fluctuations. and the assumption that 
the three groups of students began the instruction with comparable amounts 
of prior knowledge of the course material is not disproved. 

A second comparison of interest is the interaction between instruc- 
tional methods and aptitude level (IMxAL). The lack of significance in this 
F ratio indicates that the aptitude levels were equivalent across the instruc- 
tional methods. This supports more fully the assumption of equal amounts 
of prior knowledge. 

The differences observed among the aptitude levels would occur in 
less than one sample in 1000 by chance alone. That these differences 
are highly significant is not surprising in view of the use of the ELI sub- 
test in selecting these students. 

One factor which complicates the analysis is the failure to meet 
the assumption that all of the variances are equal (homogeneity of variance). 
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As can be noted in Table 2-4, the variance of the low aptitude group is 
much less than the other variances. The effect of failing to meet this 
assumption is an increase in the mean square term for the aptitude levels. 
This results in an over estimation of the F ratio for that partition and 
an overstatement of the significance of the differences. The magnitude 
of this inflation of the F ratio i« difficult to calculate but, considering the 
absolute differences among the means, it does not affect the interpre- 
tation. If the F ratio were reduced by a factor of 10, it would still be 
significant (Eiscnhart, 1947; Lindquist, 1953, page 78). 

With these data to substantiate the assumption that the students 
began on an equal basis, the post test scores should reveal the effects 
of the instructional methods. Table 2-6 is a summary of the post test, 
scores. 



Table 2-6 



SUMMARY OF POST TEST DATA 



METHOD 


MEAN 


S.D. 


APTITUDE LEVEL 


MEAN 


S.D. 


TV 


57.4 


15.2 


High 


74.2 


3. 0 


IC 


55. 7 


18. 9 


Medium 


58.3 


8.8 


CAI 


60.2 


14.4 


Low 


40.78 


11. 3 


TOTAL 


57.8 


16. 1 









To evaluate these results the analysis of variance procedure was 
used and the results of this analysis are presented in Table 2-7. 
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Table 2-7 
ANALYSIS CF POST TEST DATA 



souRCii: 


d. f. 


MEAN SQUARF 


F RATIO p 


Instructional Method 


2 


90. 39 


1. 27 n.s. 


Aptitude Level 


2 


5037. 56 


70.86 .001 


IM X AL 


4 


64.11 


0.?0 n.s. 


Residual 


45 


71. 09 




TOTAL 


53 







The results of this analysis are essentially the same as the pre- 
test scores. There were no significant differences among the instruc- 
tional methods nor in the interaction between aptitude level and 
instructional methods. There were highly significant differences among 
the aptitude levels, as would be expected. Thus, it is concluded that, 
on the average, this CAI course was as effective in teaching these students 
as either the IC or TV methods. Also, there was no difference in the 
effectiveness for the three instructional methods at any of the three 
aptitude levels . 

Finally, the time required for the CAI students to complete the 
course was obtained from the student performance recordings on the 
system. These data are summarized in Table 2-8. 
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Table 2-8 

SUMMARY OF CAI STUDENTS' COURSE TIME 



GROUP 


MEAN 




RANGE 




Hours 


Min. 


Hours 


Min. Hours Min. 


High Aptitude Level 


5 • 


43 


3 


55 to 6 36 


Medium " " 


9 


22 


7 


01 to 11 00 


Low " " 


15 


00 


9 


39 to 17 52 


Total Group 


10 


02 






Weighted Average 


9 


58 = 


88. 5% of 11 hrs. 15 min. 



As can be seen from Table 2-8, time to complete the courise 
appears to be related to aptitude level. This reflects the course strategy 
of pretesting and skipping students over material which they already know. 
The pretest data showed that the amount of knowledge prior to instruction 
was related to aptitude level, and this effect is shown in the data. If it 
can be assumed that time to complete the course is related to aptitude^ 
then to infer from these data to the Signal School population it is necessary 
to weight the obtained averages by their proportionate representation in the 
population. The high and low aptitude levels each represent 7% of the 
population and the medium aptitude level 9%. With the appropriate factors, 
the weighted average for the group is 9 hours 58 minutes. This represents 
an 11. 5% saving in time over the conventional instruction time of 11 hours 
15 minutes for the TV and IC methods. 

Of the 18 CAI students, 13 of them (72%) completed the course in 
less than the 11 hours and 15 minutes. The other five students, all from 
the low aptif ade level, required from- 14 to 18 hours to complete the 
course. 
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The results of this study demonstrate that a course of instruction 
implemented on the IBM 1500 Instructional System is as effective in 
teaching students from the Signal School population as are more con- 
ventional instructional methods (IC and TV), In addition, the CAI course 
taught the material in less time. 

In interpreting the results, several factors should be considered. 
Students who are selected for a different treatment do not behave in 
precisely the same manner as they otherwise might; they tend to per- 
form in a superior fashion. Since the CAI students knew that they were 
being treated differently, this ''halo'' effect probably produced better 
performance from these students. Additionally, because of scheduling, 
the CAI students could review and study during the day. The USASCS 
Evaluation Division Personnel who handled the CAI students felt that 
the students used this study time and thus might have improved their 
performance. These two factors may have some effect on this partic- 
ular CAI course. Unfortunately, the magnitude of the effect cannot 
be measured, but its presence should be considered in the evaluation^ 

On the other hand, these results should not be considered as a 
general evaluation of CAI. Limitations in the effort, due mainly to time 
constraints, prevented the development of a CAI course which uses all 
the unique capabilities of the system. Only limited branching was 
employed, and the course strategy must be considered as a first approxi- 
* mation. No significant revision of the course, based on student response 
data, was possible and thus one of the major advantages of CAI was lost. 

However, taken in the context of a feasibility study, the results 
do demonstrate that CAI is effective as an instructional method. Course 
material can be implemented on the IBM 1500 Instructional System to 
teach USASCS students the same amount of material in less time than 
conventional methods. 
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Section 3 



EFFICIENCY OF COMPUTER ASSISTED INSTRUCTION 

The training activity of USACS at Fort Monnu; ith 1;-: .similar in 
many respects to a manufacturing process. This training activity can 
be divided into similar and comparable units such as: an input, the 
untrained student; a process, the instruction process; and an output, 
the student graduate. If the process is analyzed from a pure cost 
approach, the objective v/ould be the production of qualified graduates 
at the least cost. To achieve this objective, the capability of adequately 
determining the cost of producing graduates would be of prime importance. 
This requires the accumulation of instructional process costs in useful 
classifications whereby cost comparisons of varioua instructional pro- 
cess alternatives are possible . 

The specific cost analysis objectives of this study are to estimate 
the cost of producing student graduates via the conventional instruction 
process currently used at USASCS, to determine the significant cost 
factors applicable to the computer-assisted instruction process, and to 
develop a methodology for determining the relative cost effectiveness of 
an IBM 1500 CAl system versus conventional training. 

3. 1 COST RELATED VARIATIONS OF THE TRAINING PROCESS 

The process of instruction may be varied in several ways relating 
directly to costs. These variables are of primary concern in achieving 
the objective of producing qualified graduates at the least cost. Fore- 
most among these is the reduction of training time involved in the 
instruction process. A large percentage of training costs at USASCS 
could be classified as period costs, i. e. , costs incurred over a period 
of time, such as instructor pay, student pay, and logistic support. It 
appears that a reduction in training time should result in reducing the 
cost of producing student graduates. 

Another important element is student attrition. Student attrition, 
whether in the status of "recirculation^^ (repeating a unit of the course) 
or failure, represents additional or lost training time. In either cir- 
cumstance, the cost of this training time increases the total cost of the 



training process and ultimately the cost of producing course graduates. 
Therefore, an instruction process change that successfully reduces 
student attrition should also reduce student graduate costs. 

Still another important element is reducing waiting time to a 
minimum. In a conventional school environment, considerable time is 
lost waiting for classes to form, waiting for assignment to classes, 
fast students waiting for slow students to catch up, etc. Reduction of 
waiting time should result in the reduction of the cost of producing 
student graduates. 

A fourth important element is the improvement of student perform- 
ance. This item is not so easily related to cost as the previous three 
items. In one respect it is analogous to attrition because improvement 
in student performance should result in reduced student attrition. The 
ability of a teaching process to successfully teach students of low achieve- 
ment and to increase the knowledge and retention of all students is an 
additional important element in student performance. The cost of 
instructing these groups would be directly related to the length of time 
it takes to train the individual. In this particular consideration, the cost 
of training the low achievement groups may be of lesser importance than 
the potential value of having the capability to upgrade the training of this 
group to higher level skills. 

The cost involved in these four variables is, of course, the accvimu- 
lation of many smaller cost items that make up the composite cost of any 
training system. All four variables relate to training time and the ability 
of a training process to produce qualified graduates in minimum time. 
The success of a highly efficient training system that produces qualified 
gradxiates in less time than conventional training methods potentially 
offers a reduction of the training "pipeline" (number of people in training 
process) yet will provide the requisite number of school graduates. 

It is with the details and the comparative relationships of the com- 
posite training costs that this analysis is concerned. 

3. 2 GENERAL COST ANALYSIS DESIGN 

The overall design of this cost analysis requires identification of 
the cost of CAI and conventional training, and the grouping of these costs 
into comparable classif!ca.tions. The costs are then consistently distributed 
by the most logical means to a common unit, the "student instructional 
hour. " This common unit provides a useful tool with which the co^t of 
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producing course graduates can he calculated by simple arithmetic for 
either instruction method or for combinations thereof. The student 
instructional hour used throughout this analysis is based on present 
USASCS class schedules. 

3. 3 TRAINING PROCESS ALTERNATIVES 

The first 3^^ns iti tho analysis is to establish the alternatives under 
consideration. The alternatives are identified as follows: 

a. Cost of CAI instruction system 

b. Cost of conventional instruction system at USASCS 

c. Cost of combinations of a and b. 

Some of the general cost considerations that should be accounted 
for when attempting to analyze the costs of a training system are dis- 
cussed in the following paragraphs. 

The total cost of implementing the system should be within the 
fiscal means of the sponsor or user. The system should be capable of 
meeting performance objectives and be cost-competitive with other 
available training systems. These are basically the tests of usefulness 
and practicality since an instructional system that does not effectively 
teach the subject matter is of questionable usefulness no matter how low 
the cost* Also, the cost of a highly effective system that exceeds fiscal 
feasibility is of questionable practicality. 

The usefulness and practicality of the alternatives under consider- 
ation should be determined in terms of cost and effectiveness. It is 
important that the third alternative be considered since the path of 
optimal cost and effectiveness may be a combination of the two systems. 

Evidence of effectiveness in regards to the abilities of the systems 
to aid the student learning process is presented in Section 2 of this report. 
Appendix C provides the details of the cost analysis of the above alter- 
natives. 

3.4 COST - EFFECTIVENESS ANALYSIS 

3.4. 1 Cost-Comparisons 

The cost of producing graduates using a system such as CAI which 
requires the outlay of large amounts of capital initially will be most cost- 
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competitive only when this system is used to its full capacity and capa- 
bilities. In addition, the schedule selected for depreciation of these 
costs has significant impact on cost competitiveness. The capabilities 
of the IBM 1500 Instructional System in areas other than CAI, such as 
data processing, should be included for total system cost- effectiveness 
considerations. 

The following table shows a comparison of the ranges of cost of 
producing course graduates by a CAI system without the USASCS costs 
of conventional training environment, the CAI system installed at 
USASCS, and the current conventional instruction costs of course 26Li20 
at USASCS. 



Table 3-1 



COST OF GRADUATE IN 840 HOUR COURSE (26L20) 



Use of CAI system per school day 
CAI System 



6 hrs. 



12 hrs. 



18 hrs. 



5 yr. depreciation 
10 yr. depreciation 
CAI System at USASCS 
5 yr. depreciation 
10 yr. depreciation 



Conventional Instruction 



$3343 
$2167 

$6923 
$5747 



$1873 
$1285 

$5453 
$4865 
$4. 092 



$1378 
$ 991 

$4958 
$4571 



Data is based on 32 -terminal IBM 1500 Instructional System 



It appears that the CAI system is cost-competitive in all cases 
where there is no conventional training environmental cost involved. 
When the system is installed in a conventional environment there appear 
to be no cost-competitive examples. Under these circumstances in order 
for the system to be cost- competitive, a reduction in training time must 



3-4 



BEST copy mmi£ 



be achieved. Impact ot attendant cost reduction with reduction in training 
time at USASCvS is as iollows: 



Table 3-2 



COST or CO-^^SE GRADUATES WITH T7PDUCTTON 
IN 840 HOUR INSTRUCTION TIME 


Use of CAI system per school day 


6 hrs. 


12 hrs. 


18 hrs. 


B yr. depreciation 








10% Reduction time 


$6232 


$4909 


$4463 


20% Reduction time 


5538 


4362 


3965 


30% Reduction time 


4847 


3818 


3471 


10 yr. depreciation 








10% Reduction time 


$5173 


$41S0 


$4115 


20% Reduction time 


4597 


3891 


3656 


30% Reduction time 


4024 


3407 


3201 



Conventional Instruction 



$4, 092 



Data is based on 32- terminal IBM 1500 Instructional System. 



The area of cost-competitiveness is achieved with a reduction of 
30% in training tiine and 12 hours per school day utilization if a 5 -year 
depreciation is selected. If a 10-year depreciation is elected, cost is 
competitive at approximately a 20% reduction in training time and utili- 
zation of 1 2 hours per school day. 

The cost data used in this analysis are only as reliable as available 
data would permit but are considered accurate enough to provide a general 
overview of the various cost relationships and demonstrate the feasibility 
of the methodology described (Appendix C has details). 
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3« 4. 2 Cost* Effectiveness 



In examining the three alternatives under consideration for 
analytical fmrposes, it is impoitant to know the maximum efficiency of 
the system. For example^ it costs an estimated $4, 092 to train a 
student in course 26L20 at USASCS* The academic attrition rate is 12J3% 
(USCONARC,1967). This represents inefficiencies in the system and 
results in increased cosj^ of producing cou]:se graduates. If there were 
no attrition, it is estimated that course graduates could be produced at 
approximately $3800. Thus, the difference between these costs is equal 
to the cost of the inefficiencies of the system. 



Attrition 




0 1000 2000 3000 4000 



Cost^Dollars' 

Figur^fe 5-1 Co iBt of Attrition 

If additional funds were available attrition co\xld possibly be 
decreased with improved instructor training, improved course material, 
and remedial coaching. At some point there would be little or no gain 
in efficiency regardless of the resources committed. This is the 
tiieoretical area of dintinishing returns and maximum effectiveness (Figure 
3-1). 

Additliji^l effort would most likely produce the most effectiveness 
if it were invested in CAI program (software) improvement. Consequently, 
the costs of inc revising the effectiveness of the system would be closely 
related to the costs of improving the presentation of the course materials 
(software). Again, at some point, committing additional resources would 
produce little or no increase in course effectiveness. 
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If these two instructional processes are to be compared on a cost- 
effective basis, the area of maximum efficiency or diminishing returns 
must be known so that a relationship between cost and effectiveness may 
be established. The optimal mixture of cost and effectiveness may be 
found in some combination of CAI and conventional training. Additional 
experience and information on the performance and costs of CAI, as well 
as conventional training, are needed for the completion of a cost- 
effectiveness analysis of these alternatives. 

3. 5 IMPLEMENTING COST- EFFECTIVENESS ANALYSIS 

3. 5. 1 Recording Student Training 

To implement effectively the methodology described in the 
Appendices, methods of accurately recording student training time are 
required. The recorded training time should include the time a student 
becomes available for instruction up to the time he has completed 
training and been assigned to other duties. Measurement of this time 
would represent the total time available for training the student. The 
burden of cost attached to this time is the cost of producing a graduate. 
Economical use of this time is essential. 

Additional instruction time as a result of attrition and recirculation, 
the time students spend waiting for classes to form and reassignment, and 
all other periods of waiting must be recorded. 

The cumulative cost of this additional instructional time and the 
cost of student Waiting time are results of the inefficiencies of the training 
process. Reducing these costs should result in increased cost* 
effectiveness. The full exploitation of available unique CAI capabilities 
shows great promise for reducing such costs. 

3.5. 2 Other Unique CAI Capabilities with Cost- Effective Implications 

The cost implications of student selection may be equated to re-- 
ducing student instructional time and the resulting burden of cost. 
Early recognitioYi of potential academic failures, remedial branching, 
individualized instruction, and various other possibilities are potential 
steps that should ultimately result in reduction of the cost of producing 
student graduates. 
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3. 5. 3 Administrative Tasks 



In areas other than the instructional process, the CAI system can 
perform various tasks which may result in increased administrative and 
evaluation capabilities and offer the potential of reducing administrative 
overhead costs. Some of these tasks include scheduling students, keeping 
student records, compiling reports, and processing data. Additional 
study of the USASCS administrative system is required before any asse^ - 
ment of these cost savings may be estimated. 

3. 6 COST COMPARISON SUMMARY AND CONCLUSIONS 

The primary thrust of the cost comparisons of this report was to 
compare two major classifications of cost of CAI and conventional 
Instruction. The comparisons are: 

a. CAI program development cost with conventional course 
development costs (Appendix C) 

b. CAI instructional system cost (IBM 1500 Instructional System 
at USASCS) with conventional instructions cost at USASCS. 

An actual cost comparison could not be made between CAI program 
development costs and conventional course development costs due to a 
lack of reliable representative cost data. 

Theoretical cost estimates of CAI course development cost could 
be developed from data on man-hours, computer time, and support data. 
However, these estimates are not presented because these data represent 
a very limited experience under a developmental learning situation, aftd;the 
resulting cost estimate coald be totally misleading and, further, may not 
be applicable to CAI course development at USASCS. In addition, con- 
ventional course development costs were not available with which to make 
meaningful comparisons. 

The data on CAI course development presented on page Z-Zrrepresehts 
the experience of one short experiment in CAI course development and 
provides a general indication of effort required. As experience and 
knowledge is gained, these factors and the attendant cost probably can be 
reduced substantially. 

Tables C-14 to C-17 provide data on the estimated cost of producing 
course graduates by conventional modes of instruction and CAI for com- 
parative purposes. Unavailability of complete cost data introduces certain 
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inconsistencies, as discussed in Appendix C. Although these data imper- 
fections are acknowledged, the data are considered accurate enough to 
provide a basis for some general conclusions. These data show estimated 
cost of the CAl system graduate for course 26L20 under various reductions 
of instructional time, depreciation schedules, and usage of the CAI system. 
The cost per graduate shown in Appendix C (page C-29) indicates^ that the 
cost competitiveness of CAI is primarily a function of reduction in 
instruction time, system utilization, and depreciation* Thus, it is clear 
J.hat in order for the CAI system to be cost-effective, it must accomplish 
a reduction in instructional time and be utilized to its full capability* 

These are the results of the cost analysis: 

o The current economic feasibility of a CAI system at USASCS 

has been demonstrated 
o Although the relative cost-effectiveness of a CAI system vs 

conventional training at USASCS has not been demonstrated, 

the costs are not prohibitive and appear reasonable for this 

stage of a developmental training system 
o Conditions under which CAI could become cost-effective 

have been identified. 
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SECTION 4 



APPLICABILITY OF COMPUTER ASSISTED INSTRUCTION 

This poition of the study investigated the applicability of CAI to 
military training oy yurveying the equipment and languages available 
and their uses, and from these developed a model for USASCS. 

This study first looked at the development of individualized instruction. 
Then it surveyed the present status and operation of hardware as well 
as the wide variety of languages available and under development. It 
reported the many, varied applications of CAI in universities, non- 
profit organizations, and private industry. CAI is used to drill and 
teach, assess learning difficulties, and respond to the student's progress 
to improve his instruction. Many traditional instructional techniques 
have been adapted to CAI so that it has taken over some of the responsi- 
bilities of the instructor.. 

On the basis of this survey, a USASCS training model was developed. 
This includes selection of material to be taught and the amount to be 
converted to CAL It also includes the types of hardware and the types, 
number, and duties of required personnel. 

4. 1 BACKGROUND 

Though the origins of programming and individualizing the instructional 
process are complex, current methods appear to have been derived from 
the research of Sidney L. Pressey, B. F* Skinner, and Norman A. Crowder, 
who are generally considered to have made significant contributions to 
the development of individualized instruction. Pressey (1926, 1927) 
observed that a student gained appreciably from seeing the results of an 
examination inrimediately. Skinner (1954) suggested the application of 
reinforcement theory to the learning process. Crowder (1959) suggested 
that the student's response may best be used as a guide for further direction 
of the student's activities. The results of the above research were imple- 
mented on electromechanical training devices and finally in Computer 
Assisted Instructional systems fCAI). 
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Electromechanical training devices, developed primarily for the 
purpose of training armed service personnel, preceded the development of 
CAI systems^ Stolurow (1961) suggests that three training devices may 
be considered to have contributed directly to the development of CAI. 
Pask (1957) developed an Interactive Decision Making Assembly (IDMA), 
adaptable to learner needs, to train radar operators. Rheem Manufacturing 
Corporation developed Didak 1001 to teach typewriter and keypunch operations; 
a computer- like device controlled the rate of presentation and problem 
difficulty. Then Pask developed the Solartron Automatic Teacher (SAKI) 
to train operators to punch information in cards. 

The difficulty with electromechanical training devices was the total 
dedication of a single machine to a single learner for a single training 
objective. In the late 1950's, a research team at IBM modified a digital 
computer for the purpose of implementing a new multi -^purpose, multi- 
student training device (Rath et al 1959)* This was the forerunner of a 
series of similar developments. 

Bitzer et al (1962) developed a Prog-rammed Logic for Automatic Teaching 
Operations (PLATO). This teaching system incorporated a closed- circuit 
television system, student control panel, and the University of Illinois* 
ILLIAC computer. PLATO could serve two students simultaneously but 
on an individual basis. Uttttl (1962) at IBM used an IBM 1410 data processing 
system to provide Computer Assisted Instruction to forty individual students 
simultaneously. Coulson (1962a) implemented a Computer-based Laboratory 
for Automated School Systems (CLASS) on a Bendix G-15 computer system. 
Swets et al (1965) used a Digital Equipment Corporation PDP- 1 to implement 
an early version of a conversional system. Stolurow (1964b) implemented a 
System for Organizing Content to Review and Teach Educational Subjects 
(SOCRA.TES) on an IBM 1620 computer. Suppes (1965b) employed a modified 
PDP-1 with sixteen student stations in order to research learning models. 
Shuford (1965) also used a PDP-1 but for the purpose of studying testing 
strategies. 

In 1965, IBM announced the first commercially available software 
package which could be used to implement CAI on a standard data process- 
ing system. 
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4. 2 CAI SYSTEMS Rvl ViE.\\' 



Every CAI System has three primary components. They are the 
hardware (or computer circuitry), the software (or computer programs, 
inrhiding the educational material), and the personnel needed to implement 
ana t>perate the system^ Personnel requirements will be discussed with 
the USASCS training model. 

4* 2. 1 Hardware 

There are two general types of hardware. The first is the totally 
dedicated type. The circuitry is designed to run only one program at a 
time at maximum efficiency. The second type of hardware is the multi- 
processing configuration which permits the simultaneous execution of 
two or more programs. Multi-processing systems which require more 
circuitry and are more expensive are not commercially available at the 
present time. Though they may cost more, they can lower costs by 
simultaneously performing other data processing tasks* Dedicated and 
multi-processing systems have common basic components^ 

a. The central processing unit contains the control, logic, and 
arithmetic circuitry of the computer* It is this circuitry 
which directs the sequence of operations, interprets the coded 
instructions, and initiates the proper signals to other circuits 
to execute the instructions. Generally speaking, the size of 
this component is affected by the decision to dedicate or 
multi-process, 

b. Large volume storage devices are needed to contain educational 
material and student data* Ideally, these devices consist of 
record units which are interchangeable magnetic disks or tapes* 
The system may be limited in the number of record units 
which can be run at any one time, but their interchangeability 
assures that the total amount of educational material is not 
limited* At least one data storage unit must be devoted to 
recording each interaction between the student and machine. 
This record, when summarized, provides the educator with 

a data base which may be analyzed to evaluate the materials 
and improve educational effectiveness (Betts, 1967a). 

c* A communications control unit must be included to handle 

messages. This device keeps the interaction between student A 
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and the machine separated from the interaction between 
student B and the machine, 

d* The input- output devices enable man and machine to commu- 
nicate* Minimum requirements include a card read/punch 
device for card input and output, a printer for listing the 
educational material and data analyses, a machine operator's 
console, and the student stations, 

4, 2. 2 Programming System. 

The CAI software package should include the CAI operating system— 
for example, Coursewriter II on the IBM 1500 Instructional System— a set 
of utility programs, and a set of data analysis programs. 

The utility programs enable the operator to copy, print, or other- 
wise manipulate the information stored in the system. The data analysis 
programs facilitate the statistical analysis of student records and other 
relevant information. 

CAI language characteristics have been reviewed by Dick (1965), 
Zinn (1965, 1967),Hickey and Newton (1967V and Hansen (1966b). A CAI 
language must be effective, efficient, and reliable. The effectiveness of 
the system is measured by the ability of the system to respond to a variety 
of instructional strategies and research tasks. The efficiency of the system 
depends upon the ease with which a course unit caa be progranuned and 
the amount of work necessary to execute the instructional activities. Reli- 
ability is the rapid detection and correction of errors. It is imperative 
that the system be capable of indicating non- executable programs prior 
to student use of the training system. 

There are five basic modes of operation which the CAI language 
should be capable of executing. 

a. Proctor : Its primary function is absolute machine control. 
This mode is generally accessible through an authority 
system which restricts its use to machine operators. 

b. Monitor: The primary purpose is system status reporting. 
Being accessible through a different authority system, this 
mode is reserved for service personnel responsible for 
scheduling and logistics support. 
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c* Author : This mode permits the construction and revision of 
course material. Access is limited to a specific storage area 
(of course unit) reserved for that maturiaL 

d. Student: This mode permits the teaching of the course material 
as it is intended to be used in the training system. The mode 
is individually accessible by each student assifijned to the course. 
It should also be accessible from th^ author mode for the 
purpose of initially testing the educational program. 

Computation ; This mode enables the user to work with the 
computational capability of the computer system. It should 
be accessible to the four other modes listed above in a manner 
which does not interrupt the normal activity of that mode* 

Hansen (1966b) has prepared a comprehensive listing of CAI languages 
currently in use. Many of these languages are part of larger, more complex 
general purpose languages. This fact should be considered in evaluating 
the efficiency of the language* Another important language consideration 
is its ability to act upon the student's responses. In scoring responses, 
the program mast differentiate between legitimate content errors and correct 
answers entered in the wrong form. Wodtke et al (1965) reported significant 
relationship between the two types of errors within a CAI course. This 
relationship showed that the student typed in the correct answer in the 
wrong form, tried the same answer once or twice more for good measure, 
and then discarded his original correct answer for an incorrect response, 
thus making a content error* This program can be partially avoided with 
a CRT devicu with light pen. But light pen capabilities imply multiple- 
choice type items, which are difficult to write and which may not be relevant to 
the desired terminal performance objectives. 

CATO is a CAI language developed for the PLATO System at the Coordinated 
Science Laboratory, University of Illinois (Bitzer et al, 1966). CATO is 
a modified FORTRAN language in which the programmer has great flexibility 
for the preparation of three levels of basic program writing: tutorial, 
inquiry, and simulation. 

The Coursewriter I language (Maher, 1964) was constructed primarily 
for the use of subject-matter writers rather than the technical person 
involved in computer programming. Coursewriter I provides power and 
flexibility for developing various pedagogical techniques. Its most impor- 
tant feature is the provision for revising instructional material easily and 
rapidly. It can also analyze partial answers (e. g. , key letters or key words). 
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The Coursewriter II Language used with the IBM 1500 Instructional 
System (IBM, 1966) provides a greater opportunity to record the instruc- 
tional history of a learner. The most important feature of this language 
is its provision for macros which standardize the logic and require the 
author to insert only the informational portions of the subject matter. 
Coursewriter II also provides for a much better control over the timing 
of the instructional events. Like other numerically oriented languages, 
it provides mathematical algorithmic translator or MAT (Iverson, 1962) 
which allows the author and student to solve mathematical equations. 

Two languages are in the process of being, developed by Bolt, Beranek 
and Newman. The first is TELCOMP, which is a nximerical oriented 
programming language. The second is MENTOR, which is part of a more 
generalized LISP language (McCarth/ £t a^ 1965). These list processing 
Uaguages, LISP tod^ENTOR, provide for great power and versatility in 
bundling natural language statements. For example, a conventional 
English declarative sentence may be entered and logical operators con- 
nected to it so that decisions can be based on the user's progress. 

Basic is a CAI language developed at Dartmouth College by Kemeny 
and Kurtr. (1966). Equivalent to TELCOMP and MAT, it solves mathemat- 
ical problems vnlth a simple set of variable codes. 

System Development Corporation is developing two languages. The 
first ie a time*- sharing language which implements the CLASS facility 
cited previously. Problem oriented, it distingxiishes between the logic 
of instructional codes and control statements. A second language called 
PLANIT, or programmed language for interactive teaching, and being 
developed by Feingold (1966), provides for both instructional activities 
and numerical analysis computation. The language has six basic instruc- 
tional codes; type, problem, question, multiple choice, decision, and 
copy. The command '^Type" allows an author to quickly insert instructional 
materials into the CAI system. The system also allows a learner to both 
calculate and answer problems. 

The THOR time- sharing language system developed at Stanford 
(Brian, 1966) has all of the features found in variable oriented CAI 
languages. Subsets of the THOR language provide mathematical drill 
problems or tutoring. A valuable feature of the THOR language is a real- 
time debugging aid called RAID (Stygar, 1965). 
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Using the SOCIIATES System at the University of Illinois, Stolurow 
and Lippert (l966) have developed a language, AUTHOR, that prepares 
course materials under computer control. AUTHOR allows for natural 
language text construction. 

Engvold and Hughes (1967) of IBM have recently published a report 
on ABAC II, which is a basic coursewriter written in FORTRAN. 

4. 2. 3 Applications 

The majority of CAI activities are centered in major universities, 
non-profit organizations and private industry. They used off-the-shelf 
CAI systems modified in many cases to fit unique needs. A few schools 
use CAI to teach regularly. Many public and private organizations are 
experimenting with a variety of subjects. Approximately 225 courses 
exist in various stages of development to teach psychology, statistics, 
economics, public administration, languages, mathematics, chemistry, 
engineering, medical science, business, and other subjects. 

Florida State University at Tallahassee has a multimedia course 
taught for credit by CAI (Hansen and Dick, 1967). Physics is taught for 
three credits on an IBM 1500 Instructional System using a cathode ray 
tube, a tape recorder, short concept films, full length films, video 
taped lectures, and a typewriter. 

Reading and arithmetic are taught to disadvantaged elementary 
school children in the Brentwood School near Palo Alto, California. 
Material developed by Patrick Suppes (1965a) of Stanford is presented on 
the IBM 1500 Instructional System by a tape recording, and students 
respond with the light pen. 

Pennsylvania State University at University Park has developed, 
under Harold Mitzel (1967), courses in audiology, introductory manage- 
ment accounting, engineering economics, and modern mathematics. 
Content was first teleprocessed from an IBM 7010-1440 at the T. J. Wats 
Research Center at Yorktown Heights; then, later it was presented by an 
IBM 1410-1440 computer at the University's Computation Center. The 
instruction presented by a random access slide projector, tape recorder, 
and typewriter has been tested on a limited number of students (Mitzel 
and Wodtke, 1965). Penn State presently has a contract with IBM to 
develop for their projected IBM 1500 IS an Audiometer Trainer Terminal. 



This unit is to be outwardly representative of typical audiometers with 
labeled switches, dials, etc. Internal instrumentation (e.g., points, 
encoders, scanner, and code matrix) would allow the unit to transmit 
to the CAI system the student's setting of the external audiometer controIs» 
which the system would interpret as a response. 

The University of Texas at Austin is using an IBM 1440 teleprocessed 
to fourteen 1050 terminals. Its CAI Laboratory, under C. Victor 
Bunderson, installed the first production model IBM 1500 Instructional 
System with eight terminals. Laboratory personnel have developed 
instruction in chemistry and mathematics (prerequisite to chemistry) 
with members of these two departments. They have developed procedures 
for writing, coding, and preparing materials (Holtzmah et al , 1967). 

IBM Corporation has trained customer engineers by teleprocessing 
instruction from Poughkeepsie to Philadelphia, Los Angeles, San Francisco, 
and Washington, D. C. An IBM 1440 is used to teach System/ 360 and remote 
maintenance (Schwartz and Haskell, 1966). 

System Development Corporation, Santa Monica, California, uies 
a Philco 2000, having a randoi*! access projector, cathode ray tube, light 
pen and buttons, and Rand Tablet. The experimental Computer- Based 
Laboratory for Automated School Systems (CLASS), under John Coulson,. 
has 20 teaching and two teacher stations (Coulson, 1962b). 

The Edison Responsive Environment, developed by O. K. Moore, 
teaches young children to read. Students learn to associate letters by 
hearing them on tape, seeing them displayed, and typing them. They 
respond by typing and recording letters, later words and sentences 
(O.K. Moore, 1963). There are ten such 'talking' typewriters in use 
by Project Breakthrough at the Westinghouse Vocational Center and more 
than 100 prekindergarten children are currently participating in the 
program. «» 

The Coordinated Science laboratory under Donald Bitzer*U8es a CDC 1604, 
which has ten terminals, slide projector and display devices (Bitzer et al, 1966). 
Lawrence Stolurow (now of Harvard) has developed a System for Organiz- 
ing Contents to Review and Teach Education Subjects (SOCRATES). Using 
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an IBM 1620/1710, he has researched psychological models of instruc- 
tion and requirements for effective teaching systems (Stolurow, 196Da,b). 

Richard Wing of the Northern Westchester Board of Cooperative 
Education Services has developed three economics games for elementary 
school children. He used a 1052 terminal teleprocessed to an IBM 7090 
computer in Poughkeepsie and an IBM 1401. In the Sumerian Game, sixth 
graders make decisions about allocating agricultural resources based on 
information presented by the computer (Wing, 1964). 

Philco-Ford Corporation has announced an automated system for 
education which combines the advantages of electronic instruction with 
two-way dialogue between the student and the instructional program. 
The school district of Philadelphia authorized a $1. 3 million contract 
with Philco in which the company will provide the school system with a 
Philco 2000 computer, four Philco 102 data processors, and 32 consoles. 
The Philco 2000 computer will interface with the smaller 102's, which 
will be installed at four schools. Each smaller data processor can be 
operated independently and can serve student terminals at each location. 
The student terminal consists of keyboard and a CRT with instructions 
presented on the tube, through a speaker at the terminal, or both. The 
student responds u^ing a keyboard or an electronic stylus (Automated 
Education Letter, 1967). 

Other instruction techniques are being developed at the University 
of California campuses at Irvine and Santa Barbara, Dartmouth College, 
Massachusetts Institute of Technology, Electronics Systems Division at 
- Hanscom Air Force Base in Massachusetts, Harvard, Stanford, University 
of Pittsburgh, Westinghouse, and Bolt, Beraxek, and Newman. The 
interested reader should consult literature reviews by Gentile, (1967) 
Hansen (1966), Hickey and Newton (1967), and Zinn (1967). 

An interest in CAI within the military has been expressed by offi* 
cials of the Army, Navy and Air Force. Besides the USCONARC CAI 
Project, the following projects are reported as currently active (ENTELEK, 
1968): 

The Army -has: 

a. CAE at the Infantry School (CAETIS) 

b. Computer Supported Supply Instruction at the Quartermaster 
School (Fort Lee) 
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c. Project Impact (HumRRO) 

d. USCONARC Educational System (CONEDS) 
The Navy has: 

« 

a. Navy CAI Program for Electronics Training, San Diego 

b. CAE at the U.S. Naval Acadeniy 

c. ONR Research in CAI (includes the exchange conducted 
by ENTELEK) 

d. Naval Air Technical Training Command CAI Project 
o* BuMed Computer Assisted Instruction Project 

I. CAI in Trouble Shooting and Maintenance 
The Air Force has: 

a. Technology of CAI - Behavioral Sciences Laboratory (BSL) 

b. Research toward CAI with Natural Language - BSL 

c. Phase II Program (CAI Subsystem for Base Management 
System) - Electronic Systems Division (ESD) 

d. CAI Needs for Air University - BSL 

4. 2. 4 Conmiercially Available Systems 

At the present time, there are apparently three hardware systems 
designed especially for CAI applications: Philco-Ford Student Audio 
Visual Interface System (SAVI), Philco-Ford CLASS System, and IBM 
1500 Instructional System. A fourth system being developed by RCA 
has the preliminary designation, 1600 Instructional System. 

o Philco-Ford SAVI 

Early in 1967, Philco-Ford announced the availability of a new 
student station (SAVI) which could be used with the Philco 2000 series 
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computer systems. This system should not be confused with the CLASS 
system. The Student Audio Visual Interface system m^,y handle as many 
as thirty- two student stations on an individual basis, 

o The Philco-Ford CLASS System hap been discussed above 
under the development work by Coulson et al (pages 4-8)» 

o IBM 1500 Instructional System 

.In 1966, IBM announced the first commercially available 
instructional system developed jointly by industrial and educational 
communities. This was the IBM 1500 Instructional System. 

The IBM 1500 IS hardware includes instructional stations, 
disk storage units, a station control, an IBM 1130 processor with card 
reader/punch, and a line printer. The processing unit and station con- 
trol act as an intermediary between the student and the course material 
stored in the disk storage units. Presently, a maximum of 32 instruc- 
tional stations may interact with the operating system simultaneouBly. • 
The instructional station is modular and consists of the following display 
and response devices: cathode ray tube instructional display and key- 
board, instructional display light pen, random ;^ccess image projer,tor, 
and typewriter. 

On October 6, 1967, RCA announced the development of a series 
of small binary computers to be used in computer aided instruction. The 
target date for initial production is mid- 1968 and, hence, design details 
are not yet available. 
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4.3 INSTRUCTIONAL TECHNIQUES IN CAI 



Those instructional techniques in basic electronics training which 
may be effectively implemented through the use of computer-iissisted 
instruction (CAI) fall into three general categories: 

a. Practices requiring low-level demands on the time of 
the instructor (e.g. , drill and practice) 

b. Practices directly and indirectly related to the counseling 
of students (e.g. i assessment of learning difficulties) 

c. Practices associated with reinforcement and improvement 
of instruction (e.g. , preparation of supplementary aids). 

Each of these categories will be treated individually. 

4.3.1 Practices Requiring Low-- level Time Demands 

Those practices which require low-level demands on the instructor's 
time include: 

a« Classroom 3upervi8ion to maintain student participation 
b. Teaching of facts and skills 
c« Drill and practice 

d. Grading of written assignments 

e. Administration and grading of tests 

f. Supervision of laboratory exercises 

4. 3. 2 Classroom Supervision 

The purpose of classroom supervision is to obtain information 
concerning the student's progress and to evaluate that information in 
order* to decide on the most appropriate sequence of activities relevant 
to the realization of the training goal. Supervision entails two tasks, 
generation of data concerning the student's progress and evaluation of 
that data. Discussion of the evaluation process will be found in the 
section related to counseling. This section covers problems of gener- 
ating data from the student^s performance* 

To obtain data on the student's progress requires some partici- 
pation on the part of the student. Student participation in the instruc- 
tional environment, in itself, may be a significant factor in improving 
learning. 
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Kurpiewski i i^Dt) :omparod the relative eff ectivener; s of four 
methods of lecturing on direct current electricity. The results showed 
that student participation during the learning process creates a more 
effective teaching approach. In a study designed to identify the sig- 
nificant factor in programmed instruction, G. L. Cropper (19^7) found 
that structuring the educational material was not sufficient. In his 
conclusions, Cropper states: 

It seems clear, on the evidence produced here and 
elsewhere, that the success of programmed instruction 
depends both on effective design of the stimulus and on 
appropriate response practice... Thus, from this point 
of view, selecting only one of two key features of pro - 
grammed instruction is not likely to produce desired 
results. 

A CAI system alters the supervisory role of the instructor sig- 
nificantly by requiring each student to make some response in order 
to proceed with the instm^Uonal activity. These responses are the 
input data which are used to evaluate the student's progress. 

4. 3. 3 Teaching of Facts and Skills 

An individualized tutorial approach to student-teacher interac- 
tions has been suggested in the literature to be the fundamental instruc- 
tional model (Skinner, 1958; Stolurow, 1964 b; and Thorndike, 1932). 
Tutorial CAI systems maybe employed to provide the desired interac- 
tion. 

A tutorial CAI system for material presentation takes over the 
main responsibility for developing skills in the use of a given concept. 
One of the most consistent findings with CAI tutorial applications is 
marked savings in instructional time with no loss in post-instructional 
achievement performance. Grubb and Self ridge (1963) taught descrip- 
tive statistics to a small number of college students via CAI. This 
CAI presentation was compared with college students' taking instruc- 
tion from the conventional lectures and via programmed text. Those 
students working under CAI completed the course material in one- 
tenth the time and performed almost twice as well on the final achieve- 
ment test as did the other two groups. Schurdak (1967) taught forty- 
eight college students a portion of a course in Fortran programming. 
When equated for mental ability, the CAI students saved approximately 
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ten percent of the work time in completing their course as opposed to 
students using a standard text or program text. They performed approx- 
imately ten percent better on the final criterion test. Goodman (1965) 
reported instruction of 3, 000 airline ticket agents via CAI. In compar- 
ison with the control group of ticket agents receiving conventional 
instruction, CAI reduced the training time by one-half, and final test 
grades were approximately five percent better for the CAI students. 

Dialogue CAI systems allow the student to conduct a genuine dia- 
logue with the computer in a manner which simulates a tutorial session. 
Weisenbaum (1966) described a dialogue system, ELIZA, based on the 
Rog-.rian psychological interview. In the ELIZA system, the computer 
considers messages generated by the student's typewriter and replies to 
the user through the same typewriter. When engaged in conversation 
with ELIZA, the user types in a statement or set of statements in natu- 
ral English. 

The ELIZA system then analyzes these statements and generates a 
response derived from, the original statement. Feurzeig (1964) repprts 
a dialogue based on the SOCRATIC tutorial system. In the SOCRATIC 
system, the student is given a list of words which specify the vocabulary 
for the problem. He sits at a typewriter console and is immediately 
presented with a problem. He is subsequently engaged in a conversation 
with the computer as he solves the problem. 

4. 3. 4 Drill and Practice 

One of the objectives of the USCONARC TDP is to investigate the 
'feasibility -of preparing students of lower aptitudes for employment in 
the electronics skills. Part of this task would be to upgrade these 
students in basic skills such as reading and arithmetic. 

There is abundant evidence from recent pedagogical and psycho- 
logical studies that students need a great deal of practice in arithmetic 
skills before a reasonable level of mastery is obtained. One of the 
natural applications for CAI is the provision for continuing practice 
and evaluation of the learner who needs extensive training. In the pro- 
vision for repeating those items which are presenting difficulty to the 
learner, Suppes £t a1 ( 1965) reported that inexperienced learners show 
progressive improvement in learning a series of arithmetic concepts 
when simple reinforcement procedures are involved in indicating in- 
correct responses and repeatinf? incorrect items immediately. 
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.Hanst'n (lV'^'>) loport^Kl loa i iiing curves which described daily 
spelling drills presented by a CAI system. Those drills indicated a 
significant improvement in spoiling competence. 

The important difference between this drill system and the tradi- 
tional teaching method is that with CAI the instructor has the capability 
of meeting the needs of each student. With this capability, each student 
can receive problems which will challenge him whereas, with traditional 
textbook assignments, no differentiation can be made^ 

4. 3. 5 Grading of Written Assignments 

When one considers the grading of written assignments, one rr)ay 
immediately recognize the role of a CAI system - the student is simply 
required to complete his assignment at the student station^ The end 
result is a problem session which is not different from the drill and 
practice application mentioned above. 

The data base provided by the CAI system provides the instructor 
with a sequential record of the student-machine interaction which per- 
mits an evaluation of the students progress (Betts, 1967a). 

4. 3. 6 Administration and Grading of Tests 

Zinn (1965) and Shuford (1965) proposed that CAI provide the capa- 
bility for a type of testing not ordinarily available in the conventional 
paper and pencil system. The most important feature of CAI in this 
application is the real-time analysis and decision-making capability of 
the system. 

This real-time analysis enables the usage of a specified data 
base to determine the exact sequence of test items to be presented. 
Mager and Clark (1963) recommended uhat branching of a learner 
systematically through a test could maximize both the desired level 
of difficulty and coverage test content. 

Hansen and Dick (1967) reported preliminary results of a sequen- 
tial testing study involving college level chemistry and physics. The 
sequential test design employed in this study is similar to that suggested 
by Rajartanam et al (1964). The primary advantage in the Hansen and 
Dick study is the use of the CAI system. 
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It is clear that the educators and psychologists desire a testing 
system which combines the objectivity of standardized test instruments 
with the advantages of individual interview techniques. The d3velop*» 
ment of devices which enable computer -controlled simulation of such 
an interview has significantly impacted the field of test and evaluation. 
Computer Assisted Instruction systems operating in a testing environ- 
ment represent a quick, efficient, and economical means of large scale 
test administration, CAI systems have been shown by Hansen and Dick • 
(1967) to be capable of analyzing the student's state, selecting a deci- 
sion rule, executing the rule, and providing the next appropriate item* 
Figure 4. 1 shows a generalized sample test structure* The objective 
of this design is to take a student of given or predicted achievement and 
permit him to work his way through the test* Upon completion, the 
student will have demonstrated a true or nearly true level of aptitude 
and ability* For example, an A student would start with an item which 
only 20% of the population woxxld pass* If he passed the item, he would 
then take an item which only 10% would pass. On the other hand, if he 
missed the first item, he wo\ild take a less difficult item* This Markov 
process would enable the student to demonstrate his true comprehension 
of the material* 

4* 3* 7 Supervision of Laboratory Acti/*n.tie8 

Concerning the supervision of laboratory activities, Hansen et al 
(1967) reported the development of a CAI system designed to monitor 
junior high school science experiments* In reporting on a use of CAI in 
a simulation of the chemistry laboratory, Hirsch and Montcreiff (1965) 
in the study of a model which simulates analytical procedures report that 
simulated environments provide the facilities for random response and 
require the student to make decisions in response to the environmental 
situation presented^ rather than to simply recognize a correct response 
or recall a memorized procedure* 

In each of the above examples, the use of a CAI system has pro- 
vided a set of data from the student by requiring him to be an active 
participant in the learning process. Three things have been accom- 
plished: 

a* data banks, containing several kinds of information con- 
cerning the student, have been created which are available 
for the evalviation of the student's progress 
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h. the instructional process has been improved by including 
student participation 

c. the instructor has been relieved of supervisory duties. 

4*3*8 Practices Related to Coxxnseling 

In addition to those practices requiring low-level demands on the 
instructor's time, several studies have investigated those practices re* 
la ted to the counseling of students* The instructor spends a significant 
portion of his time counseling* When a class fails to understand a lesson 
or a student cannot perform a practical exercise, the instructor must 
determine the reason for the failure and advise the class or the student 
on how to overcome the problem, that is, decide on the most appropriate 
sequence of activities* 

The counseling process entails an evaluation of the data on the 
student's progress* Previous sections have discussed how these data 
can be obtained in the CAI environment* The studies which follow* give 
'Examples of different types of evaluation* 

Cogswell fit al (1967) reported the investigation of a computer 
oriented counseling system* This sytem was designed to automate an 
educational interview which reviews student progress, collects student 
comments, reacts to student plans, and helps the student organize his 
schedule* 

A similar system has been reported by Tiedeman (1967). His 
information system, for vocational decisions, gives the student assistance 
in making his own career choices by giving him more complete background 
information* 

Maruyamafit al (1966) reported on the alteration of CAI dialogue 
systems for the purpose of supplementing industrial counseling* As in the 
ELIZA system mentioned above, Maruyama's system conducts a Rogerian 
dialogue with the patient-user* The purpose of this on-going investigation 
is to demonstrate the feasibility of conducting industrial counseling via 
machine while ryiaintaining the necessary emotional rapport between the 
programmer and user* and while maintaining the capability for effective 
use of relevant material. 
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C once rn in^j; prac*.ices mdiri'ctly related to the cotinseJing of 
students, < ounscuiiv^ i.s <;rratly faeilitaterl by that data base because 
of the data collection facility of a CAI system* In addition, because 
of the other capabilities of the CAI system, the CAI system frees the 
instructor to spend nioro time with the individual stud(mts (especially 
those j^tudents who are having difficulty with the material). 

4* 3* 9 Practice' Associated with Improvement of Instruction 

Those practices involving reinforcement and improvement of 
instruction also depend heavily on the data generated from the CAI 
system. For example, Jettsson and Walmark (1965) reported the 
programming of a text book. In this study, the authors prepared 
a series of programmed instruction booklets for use as supple- 
mental aids to a text book. Although this study relied upon pro- 
grammed instruction techniques, the obvious generalization is 
the application of CAI systems. 

Print routines may be designed to use the student response 
file as a guide for the preparation of summaries and other supple- 
mental aids. 

Feldrnan (1967) at the University of California at Irvine suggested 
the need for hard-copy summaries for CAI students* The Irvine pro- 
ject apparently uses special tear-away forms designed to fit conven- 
iently in a three- rinti binder. The preparation of supplementary aids 
via CAI has considerable advantages in cost and flexibility over the 
conventional method of editing the traditional text. 

Standard educational measurement and evaluation techniques 
which are appropriate for the development and revision of instructional 
materials exist, today, in th teacher training literature (Thorndike 
and Hagen 1961). Such techniques as test construction, item writing, 
item statistics, and item revision may be readily adjusted for CAI 
application (Betts, 1966). 

Measurement data for accurate evaluation of instructional 
materials is readily available for all students taking part in the CAI- 
oriented environment. In addition to providing the standard item 
analysis data for the evaluation of a particular frame or sequence of 
frames, the data system also provides the capability of investigating 
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learning protocols of new techiiiques and strategies in the teaching of 
a particular subject (Betts, 1967a). The use of the student response 
data file enables the development of adaptive instructional materials 
for various teaching strategies, i* e* , materials which can be flexible, 
depending upon the personal profile of a given student and materials 
which may legitimately be compared to other pedagogical techniques. 

Zinn (1967) has enumerated several projects which address the 
potential of computer generated materials, that is, educational materials 
automatically structured and produced by data processing systems. 

An educational material development procedure which depends 
on the standard measurement techniques is shown in Table 4-1. 
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THE DEVICLOPMENT OF EDUCATIO.XAL MATEPUALS EOR 
USE IN COMPUTER -ASSISTED INSTRUCTIONAL SYSTEM 



Identify Tasks or Course Unit To 
be Administered via CAI 



_! 

Specify Terminal Performance Objectivesv 
Diagram the Instructional Sequence 





Enumerate Relevant Enabling Objectives 




Correlate Types of Learning to Objectives 



i 

Specify Instructional Material Formats 
Implement CAI Program 



Teach Student 

i ' 

Summarize Data 

T . 

Review Project 

_ r 

fZnumerate Revisions 
Implement Revisions 



-USCONARC (196G) 
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4.4 THE USASCS TRAINING MODEL 



The approach used to identify the USASCS CAI requirements to 
support the implementation of Stage I of the USCONARC TDP was to 
define the relationships between the subject matter covered and the 
instructional methodologies used in the first seven weeks of basic 
electronics training currently given at the USASCS and approximately 
40 hours of New Equipmjent Training provided by the US Army Electronics 
Ccmmand (USAECOM). Once these relationships were established, a 
comparison of the conventional methodologies and CAI methods could 
be made to ascertain what subject material in the two training situations 
was most adaptable to CAI presentation. 

4. 4. 1 Basic Electronics Training 

The first seven weeks of Microwave Radio Equipment Repair Course 
(26L20) was selected as representative of approximately 204 hours of B&sic 
Electronics training. During this instructional period, six major topics 
are covered: Direct Current Fundamentals (51 Hours), Amplifiers (30 
Hours), Receivers (30 Hours), CW Transmitters (30 Hours), and AM 
Transmitters (30 Hours). The current Signal School week consists of 
40 periods* except for the first week, which begins on a Tuesday and 
consists of 28 periods. 

The modified Program of Instruction (POI) covering these seven 
weeks uses six instructional methods: television presentat7ons, confer- 
ences, demonstrations, practical exercises, programmed instruction, 
* and tests.. An item called miscellaneous was included as part of instruc*- 
tional time and accounts for instructor and student time spent on roll 
call, preparation for tests, moving to new classrooms, cleanup, and televi- 
sion news. 

Table 4-2 from the POI indicates the length of time each instructional 
method is used for each of the seven weeks. Without the 10 hours allotted 
to miscellaneous, the actual instructional time totals 192 hours and 35 
minuteSt The combination of television, demonstrations, programmed 
instruction, conferences, and tests accounts for approximately 80% of 
this actual time and practical exercise ac^^oiints for about 20% of this time. 



♦One period equals 45 minutes of instruction. 
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Table 4-2 

SUMMARY OF INSTRUCTIONAL TIME 
BY INSTRUCTIONAL METHODOLOGY 



I NSTRUCTIONAL METHOD 



Misc. 



TV Demo PI Conf PE Test Instruction Hrs. 



D.C. Fund 
Week I 


2:00 


9:09 




2:42 


2:00 


5:09 


0 


21 hrs. 


D.C. Ftind 
Week U 


2:10 


9-14 




4:32 


4:24 


6;00 


3:50 


30 hrs. 


A.C. 


:50 


10:24 




1:15 


4.52 


8:44 


3:55 


30 hrs. 


Amplifiers 


1:35 


1 1:13 






5:06 


8:56 


3:30 


30 hrs. 


Receivers 


1:00 


■AS 


3:3 5 




18:00 . 


5:50 


1:40 


30 hrs. 


CW Transmit- 
ters 


1:15 




2:45 




20:50 


4:15 


1:00 


30 hrs. 


AM Transmit- 
ters 


1:10 


:25 


3:00 




16:20 


5:10 


4:35 


30 hrs. 



Totol Time 

Percentage 

of Time 



10:00 40:40 9:20 8:29 71:32 44:04 18:30 202 hre. 35 min 

4.9% 20.0% 4.6% 4.1% 35.3% 21.7% 9.1% 100% 



Key: 

Misc * Miscellaneous 

TV - Television 

Demo • Demonstration 

PI - Programmed Instruction 

Conf - Conference 

PE - Practical Exercise 
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The six instructional methods are standard tcclinKjues used at all 
USCONARC schools, with minor exceptions. One ot the exceptions is 
the use of television which is employed, when appropriate, by the vSignal 
School as a substitute for the conference or lecture method. In these 
cases, video tapes are made of an instructor presenting subject matter 
to students in an actual classroom situation. These tapes are then played 
to subsequent classes in the piesence of an instructor who monitors the 
class and answers student questions at the end of the television presenta- 
tion. Another exception that programmed text^ are used primarily to 
supplement television p^'esenisitions and conference^, bu* are also used as 
reference material for out- of v:la5S ausignmenta . 

When the subject matter covered by each of the in:?tructional 
methods was examined, certain relationships were fcimd which can be 
used to determine the adaptability of this material to CAL In general, 
the subject matter is basic and requires the instructor to impart to the 
student a considerable amount of general facts^ relating to a variety of 
topics over a short period of time. In addition, basic skille have to 
be learned and concepts understood so that instruction is often repeti- 
tious, and considerable time is spent on drill and practice exercises 
covering these pomts. The instruction also has to give the student the 
oppoitunity to apply his newly acquired skill to meet course performance 
objectives • Finally, a standard has to be set to evaluate the quality of 
instruction and the student's achievement. 

Demonstr is, television presentations, and conferences are 
the main methoc sed to impart general information to the student* In 
these sessions the instructor usually covers important points and then 
asks questions to reinforce the students' understanding. Drill with 
programmed text supplements the other three methods of instruction* 
Practical exercise instruction allows the student to apply his newly 
acquired skill by requiring him to solve a problem or perform a per- 
formance objective task. Daily and weekly examinations given during 
the seven weeks provide information relative to the quality of instruction 
and grade the students' progress against course objectives. 

4. 4. 2 New Equipment Training 

Based on the recommendation of the New Equipment Assistance 
Element of the Maintenance ^Engineering Directorate, USAECOM, the 
course on Radio Set AN/GRC-103 was selected as representative of 
new equipment training. The purpose of this course is to train experienced 
personnel to inspect, test, and perform general maintenance on Radio Set 
AN/GRC-103. The course consists c^f 64 fifty-minute periods or approxi- 
mately 53 hours of instruction (Table 4-3). 
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Twenty-one and one-half hours are allotted to lecture conferences, twenty- 
five to practical exercise, and ix and otie half hours to examinations, of 
which one hour is a pretest. 



Table 4-3 

SUMMARY OF INSTRUCTIONAL TIME 
BY INSTRUCTIONAL METHODOLOGY 
(AN/GRC - 103) 



COURSE INSTRUCTIONAi. METHOD 

Radio Set Lecture/Conference PE Tests Total Hours 

AN/GRC-103 21:30 25:00 6:30 53:00 

PE = practical exercise 



The course, condticted by travelling teams of instructors, requires 
that an actual operating model of the AN/GRC-103 or training simulator 
be available at the training location. Before any instruction is given^ 
each student takes a pretest to determine his knowledge of transistore« 
Those students who have little transistor experience, as indicated by 
their grade on the pretest, are given special attention and remedial 
assignments. 

Of the 21-1/2 lecture/conference hours, approximately 6 are straight 
lectures and 15-1/2 require a student workbook. Using this workbookt the 
student is led through drill exercises in block diagram and schematic analysis^ 

Most of the 25 hours allotted to practical exercise instruction requires 
the student, directed by a team instructor, to test equipment and solve 
troubleshooting problems directly on one of the AN/GRC- 103 modules. 
The examinations given are primarily paper and pencil problem-solving 
exercises. 

4.4, 3 Subject Matter Adaptable to CAI Methodologies 

The above review established the relationships between the subject 
matter taught and the instructional methods used in Basic Electronics and 
New Equipment Training. Based on knowledge and experience in the use of 
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CAI systems, it is generaUy concluded that msitf^ivAl can ':jc developed 
for CAI presentation which is now being taught by the following standard 
instructional melhods: television presentations, conference/lecture, 
demonstrations, programmed instruction, and examinations. The 
applicable CAI methodology is: 

a. Presentation of general and specific information which 
requires a correct response to demonstrate knowledge 
and understanding of the subject matter 

b. Drill, practice, and review for acquisition and reinforce- 
ment of terminology, associations, concepts, and nomen- 
clature 

c. Administration and scoring of examinations 

d« Problem-solving exercises which allow a student to apply 
acquired knowledge to solve conceptual problems requiring 
integration of basic principles and information. 

In the case of practical exercise instruction, each exercise would 
have to be considered individually as to its adaptability to CAL The main 
considerations are type, size, and cost of the devices required in performing 
a task and the method by which successful performance is measured. The 
u9e of off-line, small, inexpensive exercise boards and test equipment used 
in conjunction with CAI during this study did demonstrate how the system 
could direct, monitor, and measure functional training* Some considera- 
tion should also be given to developing CAI training simulators which woxild 
^e connected on-line to a CAI system. These devices, under computer 
assistance, would simulate the operation of actual equipment. They would 
contain sufficient instnmientation to measure and encode student actions 
under a variety of preselected situations. In these situations, the student^s 
step-by-step performance could be monitored and measured* 

Based on this comparison of conventional and CAI methodologies, 
it is estimated that of the total instructional time allotted to each of these 
two courses 150-160 hours (80%) of Basic Electronics and 30-40 hours 
(50-70%) of New Equipment Training are adaptable to CAI presentation. 

4. 5 USASCS CAI SYSTEM CHARACTERISTICS 

The flowchart (Figure 4-2) describes the general characteristics 
of a CAI system which will provide the USASCS with the capability to 
support the implementation of Stage I of the USCONARC TDP, Specifically, 
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Figure 4-2. General Characteristics of USASCS CAI System 
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it will permit USASCS to apply those CAI methodologies identified earlier 
as being applicable to adapting electronics training for CAI presentation. 
It adapts instruction to the needs of the individual student, records and 
processes student administrative data, and provides instruction with a 
variety of media. Therefore, consideration should be given to a time- 
shared, student-station oriented system capable of presenting instruc- 
tional material to approximately 21 students simultaneously. 

The system should not be oriented toward any one instructional 
method so it will not restrict the course author from incorporating as 
many teaching techniques and media as are required to present course 
material. 

The major functions perfcmed by this operating system and 
instructional language application programs are to: 

a. Assemble and store course material written in the 
instructional language 

b. Supervise the presentation of course material 

c. Schedule service requests so that each student station has 
access to the system facilities 

d. Analyze student inquiries and responses 

e. Specify presentation media 

f. Record student responses 

g. Provide information on the status of the system 

h. Store and maintain all data needed by the programs 
executed under the operating system control. 

The sections of the student station are: 

a. Display Units 

Visual (CRT, Image Projector) 
Audio 

b. Response Units 
Keyboard 
Light Pen (CRT) 
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The exercise boards and other media, as shown in Figure 4-2, 
rare off-lino, that is, not connected to the computer. In evaluating a 
CAI system, some consideration should be given to its capability to 
control these devices directly on-line. The major equipment components 
of the USASCS CAI system described above are depicted in Figure 4-3. 

4. 6 USASCS MANPOWER CONSIDERATIONS 

Figure 4-4 describes an approach for developing and student 
testing CAI course material. To develop, implement and evaluate the 
effectiveness of approximately 150 hours of Basic Electronics and 30 
hours of New Equipment Training, the USASCS will require the active 
participation of personnel with a variety of skills, working as a team. 
The type, number, and suggested duties of personnel who should form 
the base of a USASCS CAI project team are listed in the following sub- 
sections (categorized according to fur.ction). 

4.6. 1 Technical Direction and Administration 

Personnel Type: Project Manager (1) 

Technical Director (1) 

Duties: 

a. Is responsible for planning and directing the activities of 
all CAI project personnel in the development, testing, 
implementation, and evaluation of CAI course material 

b. Coordinates the activities of contractor personnel (if 
required) 

Coordinates, with other USASCS and USAECOM groups, 
those activities directly supporting the CAI project 
mission 

d. Interacts with other CAI development groups 

e. Prepares progress reports to inform management of 
project progress. 

Personnel Type: Secretary (1) 
Duties: 

General secretarial duties. 
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Personnel Type: Clerk/Typist (2) 
Duties : 

General typing and record-keeping duties. 

4,6.2 Analysis and Evaluation 

Personnel Type: Audiovisual Analyst (1) 
Duties: 

a. Is responsible for consulting in the selection of graphic^ 
material used to implement visual portion of the author s 
program 

b. Is responsible for advising in the selection of parts of the 
author's program which use audio messages 

c. Is responsible for directing the activities of the audiovisual 
support group in the preparation of graphics and recording 
of audio messages. 

Personnel Type: Engineer /Analyst (1) 
Duties: 

a. Is re sponsible for determining the types of functional 
training aids to be used in conjunction with the CAI system 

f 

b. Is responsible for the design and development of selected 
functional training aids 

c. Is responsible for identifying and determining the modifica- 
tions necessary to interface on-line training simulators or 
other media with the CAI system. 

Personnel Type: Educational Psychologist (1) 
Duties: 

a. Consults in determining CAI methodologies 

b. Serves as an advisor in developing requirements for branching 
and in evaluating instructional performance of developed lessons 

c. Consults in the use of audiovisuals. 



4-32 



BEST COPY flMiUBlE 

DuMr h . 

a. i.- I'l. ^noris (or rlri f rin itunj; tht* sitinifUaiit cost factors 

iisi'd in c o: ripa ,-ing tht* cost of CAI with conventional methods 
of inst ructicin 

n. Is 2-csponsiblc iuv collecting significant cost dr (.a 

c, Dt*\t?lops and crxercises cost model to determine cost 
effecli vrncss of (^AI. 

Personnel Type: Experimental Psychologist (I) 
Duties: 

a« Is responsible for the design of all performance measures 

Is responsible for the administration and collection of data 
resulting from controlled evaluations 

€• Is responsible for the analysis and interpretation of 
evaluation data ccjllected. 



4. 6. 3 Course Development 



Personnel Type: Educational Specialist (3) 
Duties : 

a. Defines i ourse and lesson performance objectives and 
lesson tinablin^ objectives 

b. Schedules, directs, and coordinates the efforts of those 
authoring CAI course material 

c. Monitors the progress of the course and the quality of its 
contents 

d. Assists in di^fining course logic and in selecting audio- 
\*isuals 

e. De-'te rmines instructional niethodologies to be employed 

f. Assists in adniinistc ring con. rolled evaluation. 
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Personnel Type: Training Specialist (5) 
Duties: 

a. Is responsible for authoring course consistent with pertormance 
and enabling objectives 

b. Assists in determining CAI methodologies 

c. Flowcharts lesson logic and identifies presentation media. 

Personnel Type: Subject Specialist (2) 
Duties: 

a« Is responsible for technical accuracy of course content 

b. Assists in authoring course material 

c* Assists in selecting graphics. 

Personnel Type: Instructional Analyst/Programmer (3) 
Duties: 

a. Provides guidance in the application of the instructional 
langixage 

b* Is responsible for flowcharting overall course logic 

c. Monitors keypunch operator activities. 

4* 6. 4 Programmer and Equipment Operations 

Personnel Type: Syatems Programmer (1) 
Duties: 

a. Is responsible for operating and maintaining systems 
programs 

b. Defines and develops utility programs in support of course 
authoring and data analysis and reduction 

c. Documents all program modifications. 
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Porsonnol Type; 



EquipiTiont Opera Lor (2) 



Duties: 



Operates computer and peripheral equipment 



b. 



Determines needs lor supplies 



c . 



Schedules and maintains records on equipment use 



d. 



Supervises keypunch operator personnel. 



Personnel Type: Keypunch Operator (2) 
Duties: 

General keypunch operator duties. 

The preceding personnel list does not include those skills required 
to prepare and process audiovisuals. It is recommended that this 
service be provided by existing USASCS support groups. Figure 4-5 
summarizes the USASCS CAI manpower requirements. 

.4.7 REVIEW 

This part of the study report provides USCONARC with evidence 
as to the applicability of CAI as a medium for training Army personnel 
in courses like Basic Electronics. Specifically, by reviewing the current 
status of available CAI system equipment and languages, it was possible 
to identify the USASCS resource requirements thought necessary to support 
' implementation of Stage I of the USCONARC TDP. 

The operational CAI equipment and languages used by universities, 
non-profit organizations, and private industry have demonstrated that 
the educational and training practice employed by the Army can be adapted 
to CAI. Presently CAI is being used to drill and teach, assess learning 
difficulties, and respond to students^ progress to improve their instruction 
at several locations. Because many of the traditional instructional tech- 
niques are adaptable to CAI, routine responsibilities of the instructor are 
reduced, and therefore more of his time can be made available for 
instruction. 

The majority of the surveyed CAI activities used off-the-shelf, 
commercially available CAI systems which in some cases were modified 
to fit the individual course developer^s needs. A small percentage of the 
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BEST COPY AVAILABLE 

Applications used standard data processing equipment for which the 
drvclopfrt. h^d written their own language, operating, and utility programs 
and wore employing a variety of input/output devices. 

Looking ahead, one can see a useful application of CAI for training 
electronic maintenance technicians. The integration of practical exer- 
cises in tho USCONAP.C CAI course involved equipment not under computer 
<c.ntrol. The next logical step in the development of CAI for application 
to rnaintonanco training is the implementation of computer controlled 
-laipment Member <; of this study group have prepared a practical exer- 
cise for teaching the operation of a multimeter using CAI. The multimeter 
ts directly connected to the computer. The development of this m"ltimeter 
training unit parallel., I^p work on P3nnsylvania State University's audio- 
meter trainer cited .-j.bove (page 4-7). 

As a result of comparing the standard instructional techniques 
presently employed during the 202 hours of B^sic Electronics and 53 hours 
of New Equipment Training with applicable CAI methodologies, it was 
estimated that 150-160 hours (80%) of Basic Electronics and 25-35 hours 
(50 . 70%) of New Equipment Training were adaptable for CAI presentation. 
Based on these estimates of adaptable instructional hours and IBM experi- 
ence in developing CAI course material, the general characteristics of a 
CAI system considered adequate to fit USASCS needs were described. 
Consistent with this systems' characteristics, the major hardware compo- 
nents of the system were identified and described. 

It was generally concluded from this study task that a high percentage 
of the electronics training identified in the USCONARC TDP is adaptable 
for CAI presentation. It also appears that present state of the art com- 
mer-cial CAI hardware systems are sufficiently advanced to satisfy the 
USASCS requirements to support implementation of Stage I of the USCONARC 
TDP, It is therefore concluded that CAI is applicable for training USASCS 
personnel in basic electronics in particular and for Army training in 
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DISCUSSION 

The evidence produced hy this study den^,onot.ratcs that CAI is 
effective and efficient as an instructional method and that it is appli- 
cable to training at USASCS and by implication to Army training in 
gene ral. 

As a first step toward demonstrating the effectiveness of CAI, 
a segment of basic electronics training was actually implemented on 
the IBM 1500 Instructional System. This implementation made use 
of the same course objectives used for the current training at USASCS^ 
Working within the time frame of a six month study, the course was 
written, coded, and debugged in an unusually short period of time. 
Despite the time pressures, several innovations were included with the 
course* Animation was used on the CRT to demonstrate the attraction * 
and repulsion of charged bodies. A glossary feature was included to 
present reference material to the student at his demand* Practical 
exerciseS; incorporating '^hands-on" experience, were used to intro- 
duce basic concepts and offer practice in using the multimeter* 

The effectiveness of this implementation in teaching students 
was demonstrated by means of a controlled experiment. A criterion 
test, used to measure performance of students trained by CAI and con- 
ventional methods, was developed from the course objectives with the 
concurrence of the USASCS Department of Specialist Training. A 
methodology was devised to select sample students based on their pre- 
dicted performance in the course. T? e high, average, and low students 
in the test sample represented the range of aptitudes in the student 
population at USASCS. Equivalence between the CAI students and the 
conventionally trained students was demonstrated by their performance 
on a pretest adnunislercd prior to actual instruction. The pertormance 
of the students on the post test, administered following instruction, 
showed that the CAI course was as effective a teaching method as the 
conventional methods currently in use at the school. Thus, the iinplo- 
nvintation of a portion of USASCS training and demonstration that the 
course teaches as well as conventional instruction established the effec- 
tiveness of CAI as a method of instruction* 
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The efficiency of CAI was demonstrated by comparing the cost 
of CAI training with the cost of conventional instruction* The data 
obtained fromthe Signal School at Fort Monmouth was used - o derive 
the cost of current training, which was distributed to a cost-per-stu- 
dent-hour* With this basic unit, the cost of any particular course 
graduate could be computed* CAI costs were estimated using those 
data which were available. The main variables in the computation 
of the student hour cost with CAI are amortization schedules of hard- 
ware costs, daily usage rate of^the system, and potential savings in 
student training time. When favorable decisions concerning amortiza- 
tion and usage are made, CAI costs begin to approach conventional 
costs. When srvings in student training time of 20% are included in 
the model, the costs of CAI become competitive with conventional 
costs* An estimate of a 20% saving in student time does not appear 
unrealistic in view of a demonscrated saving of more than 11% with 
the sample of students used in the effectiveness study. Considering 
that there was insufficient time to adequately test and revise the instruc- 
tional program, the potential savings which might be achieved with 
refinement can only be estimated. Finally, it must be realized that 
CAI is still a developmental activity. When more standardized, ^pro- 
duction- type procedures are implemented, the efficiency of CAI should 
Improve over the estimates presented in this study* 

After effectiveness and efficiency were established, the final 
task was to demonstrate the applicability of CAI to USASCS training 
requirements in particular and Army training requirements in general. 
The fact that a portion of the basic electronics training at USASCS was 
effectively implemented indicates ti?e applicability of CAI. In addition, 
three other points were made in the study: ihe availability of equip- 
ment, the proportion of current USAbCS training which evidently can 
be converted to CAI, and the identification of USASCS and Army train- 
ing practices which are being implemented using CAI elsewhere. 

Three computer systems, specifically designed for CAI, were 
commercially available at the time of this study. Non-proprietary 
information available ' n two systems was presen^^d and the IBM 1500 
Instructional System describe ! in detail. A fourth system had been 
announced but would not oe available before mid- 1968. With three sys- 
tems currently available, obtaining adequate computer hardware for 
CAI should present no p/oblem. 

To evaluate to what extent CAI might be applied at USASCS, two 
courses were analyzed to determine the methods of instruction currently 



in use. One of the courses (26L20) was chosen to represent courses 
taught in liasic Electronics training. The other (AN/GRC-103) was 
selected as representative of New Equipment Training. It was pointed 
out that experience has shown material taught by television, conference/ 
lecture, programmed instruction, and examinations can be effectively 
converted to CAI. Using this criterion, approximately 80% of Basic 
Electronics courses and 50 - 70% of New Equipment Training could be 
implemented on CAI. If the cost of simulators is not prohibitive, CAI 
could be used for an even larger proportion of USASCS training. 

Evidence was presented, to demonstrate that, despite the fact that 
CAI is still a developing technology, most if not all of the training prac- 
tices in use at USASCS have been or are currently being effectively 
implemented with CAI systems. Three general classifications of train- 
ing practices were identified and numerous examples of implementa- 
tions were presented from the published literature. 

This study, then, presents evidence that CAI is an effective and 
efficient training method. Moreover, CAI is shown to be applicable to 
the training requirements at USASCS. To the extent that these require- 
ments reflect requirements of Army training in general, this evidence 
presents the same implications for the Army as a whole. 



Section 6 

CONCLUSIONS AND RECOMMENDATIONS 

It is feasible to use CAI as an instructional method ir " rmy training* 
Feasibility was demonstrated in ternns o[ the effectiveness, the efficiency 
and the applicability of CAI in satisfying USASCS and U.S. Army training 
requirements. 

a. CAI Effectiveness — A course of instruction, based on USASCS 

course objectiv^-^s , was implemented on the IBM 1500 Instructional 
System. A sample of students representing the range of aptitudes 
found at USASCS was trained via CAI and compared on a criterion 
test with performance of equivalent groups of students trained by 
television and instructor-controlled methods of instruction. The 
performance data demonstrated that training via CAI was as ef- 
fective as training via television and instructor controL More- 
over, the CAI students required 11% less time on the average to 
complete the training than the television and instructor-controlled 
method students. 

b* CAI Efficiency — When current training costs were compared 
with estimated CAI costs, it was shown that in the worst case 
CAI costs are not prohibitive. Favorable decisions concerning 
amortization and system usage improve the CAI cost picture* 
When potential savings in student training time through the use 
of CAI are included, CAI becomes cost- competitive with con- 
ventional training costs. 

c* CAI Applicability — la addition to the fact that a portion of 

USASCS training jvas effectively implemented, the applica- 
bility of CAI to USASCS requirements was demonstrated in 
three ways. Three commercially available systems were 
identified which could satisfy USASCS requirements. Analysis 
of representative courses at USASCS showed that a significant 
portion of existing courses could be converted readily to CAI* 
Finally, three general classes of instructional practices in use 
at USASCS were identified, and the ability of CAI at the present 
state of the art to handle these practices was demonstrated by 
citing actual examples of implementations from the published 
literature. 
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Based on the three criteria, effectiveness, efficiency and applica- 
bility, the results of this study lead inevitably to the conclusion that it 
is feasible to use CAI as an instructional method in Army training. 

This conclusion leads to the recommendation that USASCS continue 
its effort in CAI. Several advantages can accrue to the U.S. Army from 
a continuing effort. The immediate result is the development of an in- 
house capability. Such a capability would place USASCS and the Army 
in a unique position to evaluate and capitalize upon new advances in CAI 
technology as they develop. During this period of growth, USASCS could 
use its capability to systematically investigate the problems of the reduc- 
tion of training time and the training of lower apcitude students. The 
results of such investigations could have significant implications through- 
out the Army and Department of Defense. 

It is recommended that the Army use a modular approach to develop 
its in-house CAI capability. For example, rather than attempting to adapt 
an entire Basic Electronics course to CAI at one time, a more efficient 
and prudent approach would be to develop this course in in rements con- 
sistent with natural breaks in the course content. This modular path to 
CAI development will make possible the immediate exploitation of experience 
du ing the step-by-step process of CAI course development. As a result 
the need for extensive revision of the entire course will be minimized. 
In addition, because the state of the art of CAI is advancing rapidly, the 
modular approach will facilitate incorporation of up-to-date advances 
without extensive course alteration. 
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THE DEVELOPMENT OF THE COURSE SF,GMENT 

A- 1 INTRODUCTION 

This Appendix describes the events and activities li^ading to the 
development of a Computer Assisted Listruction course segment. The 
material included in this course is described in the introduction to the 
report. It was converted to a CAI format and implemented on the IBM 
1500 Instructional System. The procedures followed in carrying out the 
conversion and implementation are described below* One of the factors 
having a direct bearing on the course development was the four to five 
month period allocated for the task. 

A basic principle of CAI is that each student can learn a concept 
or subject according to his particular requirements. This not only means 
that each student may learn as quickly as possible, but also that the 
amount and content of material presented may be tailored to his individual 
needs. Probably the best design to achieve this principle is one containing 
multiple instructional tracks. This allows the brighter students to receive 
enriched material while slower students learn the basic fundamentals, 
each at his own rate of absorption. Students are positioned and switched 
from one track to another, depending on their ability. 

Because amulti-track design would require more than four months 
to develop, an alternative method incorporating a single track linear 
progression and containing characteristics approximating the multi-track 
design was selected. Features included a pretest to advancj^ knowledgeable 
students, query logic offering remedial help and simulating explicit branch- 
ing techniques, summary material for reinforcement, use of a glossary for 
technical vocabulary, and computer-controlled practical exercises to pro- 
vide hands-on training. The level of instruction was geared to the majority 
of students at the Signal School who have completed high school (12 years). 

Three groups of personnel developed the course — aiitbors, a subject 
matter expert, and programmers. The authors were responsible for 
designing the overall logic, the course writing, and revising;. The subject 
matter expert ensured that the material was accurate and complete. The 
programmers were responsible for implementing the material on the 
computer. This task included creating a program design to operate upon 
the course logic, converting the material to a computer language, and 
debui^ging. 
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Prior to the actual course administration, sample students were sent 
through whatever parts of the material were available. These included 
IBM personnel and three groxips of two students each from Ft. Monmouth. 
During these sessions, student performance recordings containing all 
pertinent information relating to a given response were generated. The 
author responsible for course writing used these records to locate subject 
matter areas which resulted in a common source of student difficulty. 
These areas were then revised. The programmers also benefited froxri thi« 
review process, since many of the program ^^bugs*^ were discovered by* the 
sample students and then corrected. 

A. 1. 1 Content of Basic Electronics Course Segment 

When the selection of the CAI portion was completed, a detailed 
specification of the course content was commenced. This was accomplished 
by delineating the course objectives and reviewing current basic electronics 
material. 

A. 1. 2 Objectives 

Since effectiveness was to be determined by a comparison of CAI 
with the classroom instruction at USASCS, the objectives used to develop 
CAI material were the same as those defined by the school. These objec- 
tives are contained in Lesson Plan 280. 0-1 -LP (25-38), dated 3 January 
1967, Department of Specialist Training, Fort Monmouth, New Jersey- 
During the early stages of course development, the USASCS provided IBM 
with a detailed set cf performance and enabling objectives. 

A. 1. 3 Reference Sources 

The manuals referenced by the CAI authors were those supplied to 
the students by the school during conventional instruction, including the 
Department of Army Technical Manual TM 11-661, Electrical Fundamentals 
(Direct Current ), and associated Sell-Tutor Texts (SSTS). In addition, 
the authors observed the actual classroom instruction to understand the 
current instructional methods. 

A. 1*4 1500 System Configuration 

The 1500 Instructional System was developed specifically for com- 
puter-assisted instruction. It is designed to present material through several 
different media at instructional stations. Each station consists of a cathode 
ray tube (CRT) display with light pen and keyboard, a typewriter, and an 
image projector. 
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u. CRT Display The CRT screen permits a display of any 
pattern, character, or graphic (pictvire) by illumination of 
light dots (ol,440 dots on the face of the tube). Each char- 
acter occupies an 8 X 12-dot area. A total of 640 characters 
may be displayed on the screen at one time. A graphic may 
be any combination of dots which the use,r chooses, ranging 
in size from an 8 x 12-dot area to the entire screen, a 192 x 
320-dot area. The system provides a character set of 128 
symbols, including upper and lower case alphabetic, 
numeric and special characters. The user may generate 
additional graphics. Each line holds 40 characters. The time 
it takes to change a display is 1/30 second* There are two 
ways for a student to enter a response. The first is by typing 
on the keyboard placed at the base of the screen. The second 
way is by pointing with a light pen. The student points to a 
location on the screen which is then picked up by the computer 
as a pair of coordinates. 

b. Image Projector This device holds a 9 x 7-inch display 
screen on which color or black and white images can be 
projected from 16 millimeter film. Interchangeable cartridges 
containing the film strips are inserted at the instructional 
station. The film, automatically threaded by the projector, 
can show as many as 1000 images in any sequence, as directed 
by the course program. : 

c. Typewriter This unit is similar to an IBM Selectric 
Typewriter. The changeable typing element contains 88 
characters. As many as 130 characters may be typed on 
one line. Material may be typed out by the system at a 
maximum speed of 15 characters per second* Inputting may 
be done only via the keyboard. 

There are three alternatives in presenting the instructional media. 
Since the image projector cannot be used as an input device, it is included 
as a supplementary output device in the following alternatives: 

a. All course material presented on typewriter 

b. All course material displayed on CRT 

c. Combination of these. 
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There are several advantages to using the CRT: 

a. Rapid presentation of instructional material 

Minimal format limitations 

c. Input via light pen or keyboard 

d* Unlimited character set, including graphics. 

The versatility of the CRT was the basis on which this device was 
selected over the use of the typewriter for input. To eliminate the dis- 
advantage of *'no hard copy, the student was given a previously prepared 
booklet containing summaries of each segment and lesson. As each 
student finished his first computer session, he received a copy of this 
booklet to review as needed. 

For the purposes of this experiment the typewriter was removed, 
so the instructional station contained CRT, with light pen and keyboard, 
and image projector (Figure A-1). 

A. 2 COURSE ORGANIZATION 

Material to be taught with CAI must be logically ordered and complete* 
It must also simulate the conventional classroom environment by providing 
the student with the attention and direction offered by an instructor, though 
on a one to one basis. Thus, students who are able to grasp and retain 
subject matter with a minimum of explanation may advance to new material 
in accordance with their ability; those having previous knowledge may 
accelerate. Slower students may be directed to alternate presentations, 
drills, and exercises that allow them to learn at a slower pace. 

The organization of the material controls the instructional presenta- 
tion. Six elements comprise the current course structure: segment, lesson, 
pretest, lesson test, summary, and practical exercises . 

a. Segment a division of the course into a logical entity of 
related information. The segment may be equated to a 
chapter of a book plus the classroom periods necessary 
for a teacher to cover the chapter contents. Each of the 
following structural elements exists within the segment 
as an individual section (Figure A-2). There are four 
segments in this course; 
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Teaches all concepts 
involved In the lesson 



Instructional Frame (n) 
Lesson Test I»A» 
Lesson Summary L A» 
Lesson Practical Exercise - optional 
Lesson I» B» 
Lesson Test 1. B. 
Lesson Sununary I» B« 
Lesson Practical Exercise - optional 
Lesson !• B» 
Lesson Test It B« 
Lesson Summary I»B» 
Lesson Practici 1 Exercise • optional 
• 

Lesson L Z» 
Lesson Test U Z* 
Lesson Summary I. 
Lesson Practical Exercise - optional 
Segment 11 

Figure A- 2, General Course Format 
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Segment I 

Pretest 
Lesson I« A. 

Instructional Frame (1) 

Instructional Frame (Z) 
Instructional Frame (3) 
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1. Introduction to Basic Electric ity 

2. M(>ters - - Use as Aninictrr and Voltnu>tcr 

3. Batteries Cliaracteristics and Connections 

4. Resistors Color Code and Use of Olammeter. 

In addition, two other set^numts have been included as 
supplementary topics. The first, called Intro, pre- 
pares the student for the CAI portion by teaching him 
how to use the equipment contained at the student stations. 
The student is shown the various input methods (light pen, 
keyboard, backspace, and erase), course messages 
("You're taking too much time", "You missed the target", 
"You've now finished this segment", etc.), and general 
procedures (use of glossary, signing on and off). The 
second segment, called Conversion of Units, presents a 
review of the measurement prefixes used in the course- 
micro, milli, kilo and mega— and illustrates their use. 

Lesson an individual part of a segment containing 
instruction on interrelated concepts. The lesson is made up 
of units called instructional frames (IF). An instructional 
frame contains textual information, an optional slide presen- 
tation, and remedial help in the form of one or more questions 
which will be referred to as IF questions to differentiate them 
from pretest and lesson test questions. The text portion is 
limited to three pages of CRT display. A page is defined as 
a display having a maximum of 300 characters with an optional 
graphic illustration. The IF questions measure the student's 
understanding of instructional concepts. Each IF question has 
up to three hints and several answers associated with it. When 
a student responds incorrectly, an appropriate hint appears and 
he is given another try at the question. After the last hint has 
been shown and his response is still incorrect, the student is 
given the answer and told to input it. If he does not enter the 
correct answer, this last procedure is repeated until he does. 
Figure A- 3 presents the general instructional frame flow and 
Table A-1 contains a list of the -iessons included in the course. 

Pretest -- a set of questions perlairim^ to all se^^nient objec- 
tives. The pretest is used to dcternuno whether a student has 
sufficient previous knowledge of the subjoct matter to bypass 
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Tabic A-1 
COURSE LESSON SEGMENTS 



List€*d below are the lessons in 
containing them: 

SEGMENT 

Introduction 
to 

Basic 
Electricity- 



Meter - Use 

as Ammeter and 

Voltmeter 

Batteries - 
Characteristics 
and Connections 



Resistors - 
Color Code and 
Use of Ohmmeter 



the course and tlie segments 

LESSONS 

Use and Purpose 
Survey 

Survey Practical Exercise 

Electron Theory 

Voltage 

Resistance 

Current 

Introduction to Meters 
DC Voltage 

DC Voltage Practical Exercise 
AC Voltage 
DC Current 

introduction to Batteries 
Series Battery Connections 
Parallel Battery Connections 
Series - Parallel Battery Connections 

Introduction to Resistors 
Color Codes 
Ohmmete r 

Ohmmeter Practical Exercise 



specific lessons. When a student begins a new segment, 
he is given the pretest. He is told not to spend too much time 
on any one question nor to guess at an answer. To speed the 
process for a student who does not know the material, there 
is an "I don't know'' choice available on each pretest question. 
The questions are grouped by lesson objective. That is, the 
first group of questions relates to concepts involved in the 
first lesson, the second group with the second lesson, and so 
on. As each group is completed, it is analyzed to determine 
if the student passes or fails. Passing is a minimum score of 
80%. If the student passes, the associated lesson will be 
skipped and the next group within the pretest given. If he faijs, 
the student is informed that the pretest is over and then 
directed to the appropriate lesson. From that point on until 
the next segment, he proceeds with one lesson after another. 
It is possible for a student to pass the entire pretest and 
thereby ship all segment lessons. When this occurs, the 
student is told that he is bypassing the segment instruction 
and will receive the next segment pretest. Figure A-4 
illustrates the general pretest logic. 

d. Lesson Test test questions pertaining to lesson concepts. 

These questions are similar to or identical with the corresponding 
lesson group of the pretest set. At the end of each lesson, the 
student gets the lesson test. He is presented with these 
questions one after another, without any feedback from the 
computer as to their being right or wrong. If, upon com- 
pleting the test, the student has missed any questions, he is 
presented with the Summary and then those questions he 
missed. As he responds this time, the computer checks the 
answer. If it is incorrect, an explanation of the answer is 
displayed for use as remedial help. 

e» Summary --a review of the key points contained in the lesson. 
It is presented only to those students missing one or more of 
the lessen test questions. 

ft Practical Exercise units of a segment devoted to hands-on 
training. The transition from classroom theory to practical 
application is sometimes a difficult process. It is extremely 
important that a student begin using the equipment in the 
proper manner and that these procedures are reinforced 
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Figure A -4. General Pretest Logic 



rather than for him to have to unlearn and restart because of 
improper usage. For this reason, the practical exercises are 
designed to guide and student through the operation of his 
equipment under computer control. Each time the student 
performs a new manipulation, he inputs his response. If it is 
incorrect, a description of the proper procedure is displayed. 
The student then corrects the operation and continues. There 
are three practical exercises in the course. The first 
consists of a simple circuit containing two batteries, a rheostat 
a lamp, and a switch. The student is able to see the relations- 
ship of resistance to current by varying the resistance in the 
rheostat and observing the changing brightness in the lamp. 
The second requires the student to set up his multimeter as 
a voltmeter and record the voltage readings taken across 
various terminal points of five connected batteries. In the 
third practical exercise, the student is asked to use the 
multimeter as an ohmmeter to measure the value of a set of 
resistors. Figure A- 5 presents the general course logic flow. 

A. 3 INSTRUCTIONAL STRATEGIES AND TECHNIQUES 

An important part of this course design is the organization, which 
has been previously described. A description of the strategies and 
techniques completes this section. 

A. 3. 1 Strategies 

The majority of questions were multiple choice with four alternatives. 
S^nce the student uses the light pen in pointing to an answer, inputting 
errors (e. g. , typing a wrong letter, misspelling a word) and complexity 
of computer error analysis arc minimized. Constructed response (fill-in 
type) questions, used infrequently, were included when required by the 
terminal performance objectives. 

The student is allowed to progress at his own rate during the instruc- 
tional frame portions of the lesson. There is no limitation on how long 
he may take to read a specific textvial presentation or respond to an IF 
question. 

The pretest and lesson test questions have a two-minute response 
limit. If a student has not responded within the given time, the answer is 
considered incorrect. 
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Note 1. In the Meter and Resistor Segments, 
the Practical Exercises are presented upon 
completion of the appropriate lesson. 

Note 2. The student is always given the 
Pretest before the lesson on AC Voltage 
in the Meters Segment. 



Fir^nire A-f. General Course Logic Flow 



All IF questions must be answered correctly before the student will 
be allowed to continue in the course. Figure A-6 gives the general course 
logic for each lesson. 

Computer analysis follows each question within the pretest set. 
When 20% of a group has been missed, no further segment pretest questions 
are presented. Figure A-4 shows the pretest section of the course logic. 

The student is kept aware of his position in the course and of what 
material is just ahead. All structural elements (segment, lesson, etc. ) 
have their own introduction, title, and a description of the contents. 

The student is kept informed of his academic achievements. For the 
IF questions, he has an immediate feedback. At the end of each lesson test 
a message states the number of questions answered correctly out of the 
total number. After the pretest group, the student is told whether his 
answers indicate he knows the material and it can be skipped, or whether 
he must take the instructional lesson. 

Since this material is an introduction to basic electronics, the student 
is required to learn many new terms and concepts. To help accomplish this^ 
a glossary containing definitions and explanations of key items is available 
for use by the student during any IF question. When a request for the 
glossary is initiated, a list of those items previously taught (as the student 
progresses through the course, more and more terms are accessible) are 
displayed. The student can then choose one or more of these and receive 
an explanation of each item. Upon finishing with the glossary, he is 
^returned to the IF question. 

At the end of each day*s computer session the student is given a 
booklet containing a summary of the material just covered. This helps 
the student with his review prior to the next computer session. 

The role of the proctor in CAI is to assist students in completing the 
course with minimal interference. Along with setting up equipment for 
the practical exercises, he ensures that a student continues to progress 
with the material. 

A. 3.2 Techniques 

The following CAI techniques were employed: 
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Figure A- 6, Instructional Lesson Flov/chart 
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a. Rolling out effect Words and sentences roll out in the 

CRT in time with the student's reading. This has the effect 
of varying the format of each CRT display. 

b* Underline Specified words and sentences are underlined 
for emphasis. 

c. Multi-media The image projector in color and the CRT 
supplement each other. 

d. Blinking effect Specified words and sentences are blinked 
on and off to stress their importance. This technique is used 
mainly to indicate those terms being placed in the glossary* 

e. Special characters Symbols are displayed, such as fi for 
the prefix nuci*o. 

£• Graphics Special pictures are presented on the CRT along 
with textual information. An example of a graphic Ib the 
schematic representation of a closed circuit containing two 
batteries and one resistor. 

g. Animation Movement is used to illustrate some of the con* 
cepts. For example, the student is taught that LIKE charges 
repel each other and sees + signs (positive charges) moving %way 
from one another on the screen; and that UNLIKE charges 
attract each otaer and sees + signs and - signs (negative charges) 
moving toward each other. 

A. 4 COURSE WRITING 

When the logic design was completed, effort was directed toward the 
actual course writing* Three groups were primarily responsible for this 
phase: authors, a subject matter expert, and artists. Procedures were 
established to maintain team coordination and insure uniformity and 
completeness of the material. These are now described in task order. 

a. Detailed Set of Objectives /Segment - The authors completed 

the Segment Header Sheet by choosing from the overall course 
objectives those relevant to their segment. Lessons were 
then defined in accordance with these objectives (Figure A- 7). 
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Figure A-7« Segment Heade*' Sheet 
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Detailed Set of Objectives /Lesson * The Lesson Header 
Sheet, one per lessoni was completed* The lesson objectives 
were a refinement of the segment objective. Items placed 
under the previous concepts portion are used to relate 
material in different segments and lessons (Figure A*-8). 

« 

Detailed Set of Pretest and Lesson Test Questions - The 
authors generated test questions based on segment and lesson 
objectives* This technique ensured that the authors were 
thoroughly familiar with the objectives and that their resultant 
instruction, guided by the test criteria, covered these objectives* 

Definition and Usage of Terms - Each author submitted a list 
of terms he introduced along with those he assumed to have been 
previously defined. These lists were then compiled on one sheet 
for distribution to all authors and the subject matter expert. 
Didicrepancies were eliminated and a common terminology 
established throughout the material. The authors then designated 
which tc rms they wished to have included in the Glossary. 

Course Writing - The authors wrote their material. This include 
selection of material, construction of IF questions, specification 
of slides and graphics, specification of answers, both correct 
and incorrect; use of practical exercises; and format of 
summary. Several forms were created for this task to identify 
areas within the course structure. 

1. Text Sheet * Used for stating questions and instructional 
information. All material slated to appear on one page 
of a CRT display, except for incorrect response displays 
(hints, explanations, answers), was contained on these 
sheets (Figure A- 9). 

2. Answer Analysis Sheet « Used for hints, explanations, 
and answers to all questions (pretest, lesson, and IF), 
(Figure A- 10). 

3. Slide Sheet * Used by authors for drawing preliminary 
pictures (Figure A*ll). 

4. Graphic Sheet - Used by authors in sketqhing preliminary 
graphics (Figure A^IZ). 
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A description of the Test Sheet and Answer Analysis Sheet contents 
follows: 

a. Frame Number - Identifies an Instructional Frame. It contains 
segment identification (ID), lesson ID, and frame ID* The 
segment ID is a single letter unique to each segment. The 
lesson ID is a sequential number beginning with 0 for the segment 
pretest. The frame ID is a sequential number beginning with 

1 for each lesson. An example of a frame number is B0433 
where B represents the battery segment, 04 the fourth lesson in 
B, and 33 the thirty-third instructional frame within the fourth 
lesson. 

b. Type - Designates the type of display, using one of the 
following three letters: I, Q, or T. I stands for instructional 
or summary material, Q for instructional frame (IF) question, 
and T for pretest or lesson test question. 

c. Textual Material - Contains display contents. Special techniques 
such as words to be underlined, blinked, etc. , are indicated 
here. 

d. Graphic or Slide ID - Comprised of segment ID, display ID 
(S for Slide, G for Graphic), and sequential number from 01 
for each segment. Where more than one segment uses the 
same slide or graphic, the first segment specifies the segment 
ID. 

e. Answer Analysis Logic - Contains the correct answer to a 
question, anticipated wrong answers along with an explanation 
of why the answer is wrong, and general hints and explanations 
for other responses. 

f. Subject Matter Specialist Review - At various points during the 
writing phase, the authors and subject matter specialist con- 
vened to review the maierial for accuracy and clarity. They 
discussed the types of exercise boards desired by the authors. 
The subject matter specialist was responsible for designing 
these boards and having them produced. After these reviews, 
the graphics were turned over to programming personnel for 
implementation and the pictures to the artists for coirpletion 
prior to placing on film. ^ 



All illustrations and exercise boards were prepared by the USASCS. 
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g. Display Material - The authors decided upon the format for a 
particular display and then transcribed their material from the 
text or answer analysis forms to the Display Planning Guide 
form. To display material on the CRT, a set of coordinates 
which specify the area and position on the screen for a display 
must be defined. Since the Display planning Guide form is 
made up of rows and columns, the programming group used 
these forms to assign the proper coordinates as determined 
by where the authors had placed their material (Figure A- 13). 

A. 5 COMPUTER IMPLEMENTATION 

Implementation was divided into four stages: programming, key- 
punching, assembling, and debugging. The first two were concerned with 
the preparation of material for the computer, and the last two wxth the 
operation of the material while on the computer. • 



a. 



Programming - Programming consisted of two tasks, program 
design and coding. In program design, methods were devised 
to handle the course logic framework. 

This included requirements for: 

1. Forming the structure of each element in the course 
organization. 

2. Specifying procedures for transition from one element 
to another. 

3. Generating logic to control studentprogress and 
presentation. 

4. Evaluating logic for pretest and lesson test. 

5*. Presenting instructional effects, such as blinking words, 

clearing screen between frames, etc, 
6. Specifying general logic requirements such as timing 

questions, use of glossary, setting up computer system, 

etc. 

In the coding task, material was converted to the Coursewriter 
U programming language. Three subtasks were included in this 
phase. First, the written course material on the Display 
Planning Guide forms was coded. Second, the graphics and 
special symbols were formed and coded. Third, the logic 
specified by the program design was coded. 
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Macros were created to reduce the amount of coding. A macro 
is a skeleton of coding unit. The programmer inserted 
variables into a macro and then used it as if he had done all the 
coding. An example of macro usage is blinking words. When 
this effect was desiredi a single line of coding called forth the 
macro. The macro coding was then automatically filled in. 
Without a macro the programmer would have had to code the 
eight lines separately. 

b. Keypunching - Instructions on the coding sheets were punched 
one to a card by an operator. When a lesson had been completely 
punchedi its logic, course writing, and macros were merged to 
form an individual deck of cards. The lesson was then ready for 
assembling. 

c. Assembling Each lesson was loaded and run on the computer. 
During the assembly, the computer checked the program for 
errors and, upon finding any, listed them* 

d. Debugging The programmer had those cards with the listed 
errors repunched. He then reviewed the lesson for general 
logic bugs. These were corrected and the lesson reassembled. 
After three iterations of the above, the lesson was turned over 
to the author for the review and revision phase. 

A more comprehensive description of the implementation 
methodology and computer operation may be foxmd in the final 
portion of this appendix. 

A. 6 REVIEW AND REVISION 

After the lesson was implemented on-line review of this material 
was initiated. Three additional forms were created: 

a. Lesson Review Form (Figure A- 14) 

b. Change Form (Figure A- 15) 

c. Comment Sheet (Figure A- 16), 

The on-line review process is divided into two stages. In the first, 
or Pre-Student stage, authors reviewed their material to determine whether 
the content and logic were what they had intended. Concurrently, other 
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Figure A-14. Lesson Review Form 

A-28 



CHANGE FORM 
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A* Add: After Frame Number 
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project personnel reviewed the material for technical and grammatical 
correctness. In the second stage, sample students took portions of the 
course and authors studied the students^ performance recordings for 
possible course material revision* 

A. 1 First Stage General Review Procedure 

a. Authors reviewed each lesson on the computer by comparing 
the screen presentation with the corresponding display guide 
page. Upon encountering an area where a change was desired, 
they completed the Change Form and where necessary generated 
a new display guide sheet. These were then turned over to 
programming for implementation. 

b. All other people reviewing lesson material followed this 
procedure: 

1. Took lesson instruction in one complete pass and filled 
out Lesson Review Form 

2. Reviewed lesson material frame by frame and filled out 
Comment Sheet, if necessary, and turned them over to 
the author. The author then revised his material 
accordingly. 

A. 6. 2 Second Stage Review Procedures 

Sample students took the course. At the end of each lesson, they 
were asked to fill out the Comment Sheets. When completed, these forms 
along with the performance recording data provided the basis for revisions. 

Student Performance Recording (Figure A- 17) is an optional feature 
which, when requested by an author, has the 1500 Instructional System 
automatically write a record (either on tape or disk) containing items 
specified by the author for every student response (Figure A- 18). These 
records used to determine whether Or not questions were answered 
correctly, record actual responses, response time, and other information 
to provide a complete picture of student activity. By evaluating these 
performance records, the author is able to pinpoint common areas of * 
student difficulty. He can take action to enhance the instruction in those 
areas (Figure A-19)* 
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Record Number 12 Course Name -Sample Student Number SOOI 

Time of Recording 0r38 Response ID 002027IP 

Match ID CI Latency Time * 0025. 2 seconds 

Student Answer 12 Characters - Resistance AM Date 12-05-67 
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Figure A- 17. Sample Student Performance Recording 
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The 1500 Instructional System writes performance records, requested 
by an author at the time a student is registered for a course. A performance 
record is written for each response entered by a student. AH items contained 
in the record are optional and may include: 

a. Student number 

b. Name of course 

c. Clock time of recording (used to determine the length of time 
taken between questions) 

d. Latency time (time required to complete a response) 

e. Response identifier (to distinquish among responses) 

f. Actual student lesponse 

g. Match identifier (right or wrong) 

h. Contents of any counters and switches used by the author to 
record special information 

i. Other relevant material. 

Figure A- 17 is an example of a student Performance Record. 

During instruction the function of the glossary was to provide the 
student with a definition or explanation of a requested term. Since most 
questions had this feature, it was employed by the author and reviewer to 
indicate a specific problem area (material too difficult, incorrect, not 
clear, etc. ) without disturbing the course logic flow. The glossary was 
not available during review. Each time the glossary option was chosen, a 
performance recording was generated and the program requested another 
response to the question. By examining the performance recording listing, 
an author and reviewer could pinpoint the problem areas and refer to the 
appropriate course material for possible revision (Figure A- 20). 
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A. 7 COURSE DOCUxMENTATION 



A. 7. 1 Course Description 

a. List of Segments 

The USCONARC course is named CONAR. It consists of 
24 Coursewriter II segments. The list below describes 
the content of each such segment: 



SEGMENT NUMBER ' DESCRIPTION 

0 Introduction Unit Pretest 

1 Uses of Electricity and Purpose of 

Course 

2 Survey of Electricity 

3 Electron Theory 

4 Voltage 

5 Resistance 

6 Current 

7 Conversion of Units 

8 Meters Unit Pretest 

9 Introduction to Meters 

10 DC Voltmeter 

11 Meter Practical Exercise 

12 AC Voltmeter 

13 DC Ammeter 

14 Batteries Unit Pretest 

15 Introduction to Batteries 

16 Series Batteries 

17 Parallel Batteries 

18 Series - Parallel Batteries 

19 Resistors Unit Pretest 

20 Introduction to Resistance 

21 Resistor Color Code 

22 Ohmmeter 

23 Resistors Practical Exercise 

24 Glossary 



b. Unit Structure 

The course is divided into four logical units: Introduction, 
Meters, Batteries, Resistors. Each unit is started with a 
pretest, which determines if a student may skip one or more 
lessons in that unit. Figure A- 17 shows the details of 
course flow. 
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Lesson Structure 

Instructional lessons consist of instructional problems and 
lesson test problems. Figure A-5 shows this instructional 
lesson logic. 

Practical exercises have no summary or test. 
Pretest Structure 

The course contains a set of pretest problems for each 
lesson that a student may skip. A student fails a pretest 
when he exceeds the allowed number wrong for that lesson. 
The limits are: 

NUMBER *OF PROBLEMS ALLOWABLE 
ON LESSON PRETEST NUMBER WRONG 



When a student exceeds the allowed number wrong, he 
is given no further pretest problems for that lesson but 
is sent to the instructional material (Figure A- 17). 

Use of Switches, Counters, Return Registers 

The course uses switches: S1-S25 
The course uses coxinters: C1-C14 



The course uses return registers: RRl, RR2 
Description of Identifiers, Labels 

The following conventions were used in most of the USCONARC 
course material. Exceptions do exist. This information is 
useful in interpreting performance records. 

1, EP Identifiers - EP identifiers are 10 characters 
long and coded as follows: 



1-4 
5-9 

10-13 

14- 



0 
1 
2 
3 



C20-C22 



CHARACTER NO. 



DESCRIPTION 



1-2 



GO -Introduction 

01 - Meters 

02 - Batteries 

03- Resi8tors 

04- Conver3ion of Units 
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Lesson Number 



^^-8 Problem Number 

9-10 IP-Instructional Problem 

LT-Lesson Test Problem 
PT-Pretest Problem 
PE-Practical Exercise Problem 

Match Identifiers - Match Identifiers are two 
characters long and coded as follows: 



CX^'- Correct Answer 

WX* Wrong Answer 

UI Unrecognizable Answer 

GI Glossary Request 

UP Light Pen Response-Missed target 

CS Correct Answer - Spelling error 



♦NOTE: X is some numeric or alphabetic character 

Labels - Labels are six characters long and coded 
as follows: 

CHARACTER NUMBER MEANING 

1 I Introduction 

M Meters 

B Batteries 

R Resistors 

2-3 Lesson Number 

4-6 Frame Nxxmber 

Labels in the pretest and practical exercise 
segments do not follow this conventioii. 

Glossary 

Segment 24 in the course is the glossary (Figure A-21). The 
glossary is accessed in a closed subroutine by the student for 
instructional problems as follows: 

1. On multiple -choice problems (light pen) by pointing 
to the "Glossary'^ choice. 

2. On fill-in (keyboard) problems by keying '^GLOS'*. 
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Once in the glossary, the student may ask for the defini- 
tion of a term by keying it in, scan all available glossary 
terms, and point to the one he wants defined, or he may 
ret\irn to the course. The glos^^ary contains 38 terms. At 
the beginning of the course, the glossary is empty. As the 
student proceeds through the c^oxirse, glossary terms are 
'^added'* by setting switches to I in course -writer counters 
C20, C21 and CZ2. Ot\o switch is used for ^^nch tcvrv. 

Counter 14 and return register Z are used by the glossary 
routine to return to the proper problem in course segment. 
Each lesson initializes counter C14 to hold its segment num- 
ber and initializes return register 2 to hold the label heading 
the current problem* The glossary routine executes a trans- 
fer instruction to return to the beginning of the current course 
segment. The first executable instruction in the segment is 
a branch to return register 2 (BR, RR2); this returns con- 
trol to the current problem in the course. 

Glossary calls fianction LD, which was written to minimize 
response time in the scan option of the routine. 

The list of glossary terms contains the label of the frame 
in the course in which the term is introduced and the switch 
niimber used to determine the term availability. 
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GLOSSARY TERMS 



NO. 


TERM 




o W 1 i O 


1 


Absolute Tolerance 


R02 17 


7 n A 


I 


AC Voltace Procedure 


M0307 




3 


Ampere 


10324 


7 or* 


4 








5 






20E 


6 


Canacitv 


xj \J ^ J J 


^Ur 


7 


ColoT Code 


R0201 




8 


Condiic tanr ^ 


10647 




9 


Condiic tor 




7 HT 


10 


Current 


10 '\? 1 


7 HT 


11 


DC Current Procedure 


M0501A 

XVX w *^ w X «1W 


70K 


12 


JDC Voltace Prnr^diirp 


XVX U £i O O 


7 n T 


13 


Electrode 






14 


Electrolvte 


Rn?nA 


7 nx/ 


15 


Electromotive Force 




7 OM 


16 


Function Switrh 


IVI i U J 


7 no 


17 


InDut Jacks 


Ml n'^ 


7 1 A 
^ 1a 


18 


Insulator 


X\J*t*t*t 




19 


Internal Resistanrp 


Rn?? A 


7 1 <^ 
^ 1L# 


20 


^^eter Farp 


iVL 1 U J 




21 


^^eter Plii^fi 


iVli J 1 


^ X JJ 


22 


Ohm 


XKJJ I O 


^ li? 


23 


OKm.s Z*>rn Adi 

^^AAAAA^ »^ W J. W AibU 1 • 


iVL 113 


7 1 

^ ICj 


24 


Parallel Batterv 






25 


Primarv Cell 

*m A AAA Awv A w X X 


R07 1 


cix 


26 


Probe s 


.'VL 1 J 1 


^ 1 J 


27 


Ranee Switch 


M 1 1 

IVX 113 


7 1V 


28 


Resistance 


103 1 4 

XU Jit 


7 1 X>f 


29 


Resistor 


lOfi 1 1 


7 1 T 
b 1 Xj 


30 


Secondarv Cell 


R07 1 A 


c IJN 


31 


Series Battery 


R03 0*5 


7 1 n 
^ 1 ^ 


32 


Series ODtJOSina "Ratferv 




7 1 ID 


33 


Series - Parallel Ratte rv 

^ w A A ^ A A X A X XC X XJCk L L w X y 


RO A07 
X3U o 


7 7 A 


34 


Test Leads 


JVl 1 J 1 


i5 


35 


Tolerance 


R 07 1 7 




36 


Volt 


10304 


22D 


37 


Voltage 


10301 


22E 


38 


Voltage Drop 


10630 


22F 



Figure A-21. Glossary Terms 
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A. 7. 2 Machine Requirements 



BEST COPY RVAIlABLt 



The course requires three disk drives, one for the system pack 
and the other two for course packs* If performance recording is de- 
sired, either one additional disk drive or a magnetic tape unit (avail- 
able on 1500/1800 only) requiri^d. The course requires student 
stations consisting ui a ibiU CRT/Keybuard and iblZ film projector. 
The film cartridges are usable only on 1512 Model A units. It is 
suggested that 1518 typevvriter be assigned as a proctor station while 
the course is being administered. 

A. 7. 3 ' Procedure for Bmiding the Course 

a. Initialize disk packs 00000 
OOOOi 
00100 
00101 

h. Configure system pack (00000) from master pack 
(32767) 

c. Replace system dictionary (SYSDCOl) from cards 

d. Load graphic set CONAROl from cards 

e. Load coursewriter functions from cards 

f. Load coursewriter macros from cards 

g. Register au^thor HOOl 

h. Register course segments CONAR-00 through CONAR- 13 
on pack 00100 

k Assemble course segments CONAR-00 through CONAR-24 
from cards 

j. List course segments oA printer (optional) 
k. Catalog course 

L The course is now ready for a student session, 
A. 7,4 List of Card Decks 

a* Disk pack Initili/ation Cards 

b* System Conf\R\iration/P ^^^onf^^urn ! -ti ^-'is 
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System Dictionary - SYSDCOl 
Coursewriter Functions 

1. LD 

2. LT 

3. ED 



Graphic Set - CONAROl 



Coursewriter Macros 


1. 


MBHOOl 


2. 


MCHOOl 


3. 


MDHOOl 


4. 


MFHOOl 


5. 


MGHOOl 


6. 


MHHOOl 


7. 


MRHOOl 


8. 


MSHOOl 


9. 


MTHOOl 


10. 


MUHOOl 


11. 


MWHOOl 


12. 


MXHOOl 


13. 


MZHOOl 


14. 


ESHOOl 


15. 


ETHOOl 


16. 


MEROOl 


17. 


MER002 


18. 


PTROOl 



Course Decks CONAR-00 through CONAR-24 

LSTCSE Cards CONAR-00 through CONAR-24 

PERFOR Cards for Students 5050 -SO 55 

S060-S065 
S070-S075 

Operational Procedures During Course Administration 
Procedure for Starting the 1500 System 

1. Press ON at CPU 

2. Turn on 1510's, 1512's, 1518'8 
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3. Movmt disk packs BEST COPY AVMIABLE 

a. Pack 00000 on Drive 0 

b. Pack 001.00 on Drive 1 

c. Pack 00101 on Dviv- ? 

4. Wait for Disk READY lights 

5. On CPU press: 

a. UvlMEDSit^P 

b. RESET 

6. Load Coldstart Deck (3 cards) into reader, 

7. Press PROG LOAD on CPU 

8. Mount daily performance tape containing tape 
ring on 2402 Drive 1 

a. Thread tape- past tape mark 

b. Press RESET 

c. Press LOAD REWIND 

d. Press START 

9. Sign on typewriter as proctor 

b. Procedure in Initializing the 1500 System for a 
Student Session 

1. Start the 1500 System (steps 1-9 above) 

2. At proctor station: type 

a. assign 6; All 

b. date 11/16/67 

c. clock H-AZ 

d. register (0) conar/s001, , 111111 

e. perform T, 1 

f. latency 9999 

3. Load film i^i to ISi?. 's 

4. At proctor sta ' ; >•> 



a. 


. id 


f0 


b. 


id 


11 


c. 


xd 


f3 
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, BEST COPY AVAILABLE 

5. Sign students on conar-OOO /s00 1 , , I 
Procedure for Shutdown of 1500 System 

1. Sign all students off 

2. At proctor station: 

a. Perform u, 1 (Writes End-of-File) 

b. Off 

3. Dismoxmt Perform tape 

a. Press RESET 

b. Press LOAD REWIND 

c. Press UNLOAD 

d. Unthread tape 

4. On CPU press: 

a. IMMED STOP 

b. RESET 

5. Press STOP on each disk drive 

6. When UNLOCK lights come on, dismount disks 

7. Unload film from 1512's 

8. Turn all 1510's and 1518's off 

9. Remove cards from reader, press NPRO 
10. Press OFF at CPU 

Procedure for Listing Performance Tape 

1, Start system (steps 1-5 above) 

Only disk pack required is Pack 00000 

2, Be sure that End-of-File Mark has been written 
on tape 

3, On reader press NPRO 

4, Load Perfor Deck into reader 

5, Load 3-part paper into 1443 
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6. Press READY on 1443 

7. At proctox* station: schedule perfor 

8. Performance tape will now be listed 

9. At end of job shutdown iSOO (see shutdown, above - 
Do not do step 2a) 

e. Procedure for Restarting 1500 System 

1. On CPU press: 

a. IMMED STOP 

b. RESET 

2. Check POWER ON 

3. Check disks ready 

4. Check tape ready 

5. On reader press NPRO 

6. Load Restart Deck into reader 

7. Press PROG LOAD on CPU 

8. Students will now be restarted; proctor will 
still be signed on 

9. Note trouble in log 

10. If hardware errors persist, call customer engineer 
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APPENDIX B 



PROCTOR INSTRUCTIONS 



B. I EQUIPMENT OPEEIATION 

a, Start-up procedure 

IBM personnel will make all preliminary preparations 
regarding initialization of the COURSE WRITER operating 
system (mounting of disk packs, tapes, film strips, etc. ). 

IBM personnel will set up each student station. Each type- 
writer will be placed under the table (behind the student as 
he faces the CRT), Each typewriter will be turned off. 
Each image projector will be moved close to the CRT. (See 
photograph attached to Appendix A. ) 

b. Student sign on/ sign off 

Students will be given a card containing their name, student 
number, and the CAl course identifier on Wednesday even- 
ing. This card will also contain the regularly scheduled 
appointment times, the sign on procedure, and the sign off 
procedure. (See Sample Student Card.) A copy of the above 
information will be attached to these instructions (Student 
Registration Form), 

Students will be expected to execute the sign on/ sign off 
procedures as those procedures are required or requested. 
Students will be told that they must: 

1. Sign off before leaving the terminal unattended 

2. Sign off for rest breaks only between Lessons (not 
within lessons) - emergency situations excepted 

'i. Sign on and continue working immediately after 
returning to the terminal. 

When the student completes the course (resistors practical 
exercise is last) he should be given the opportunity to take a 
break before taking the criterion test. 
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The criterion test will be administered in the terminal room 
with the student located away from those still working on the 
course material. (See Addendum F» ) 

Shutdown Procedure 

IBM personnel will be responsible for turning of.^ *he equip- 
ment and policing the appropriate areas after all students 
have completed their d aignated day^s work. Prior to 
equipment shutdown, IBM personnel will: 

h Verify that all students have been signed off 

2. Remove and account for all film cartridges 

3. Turn off all CRT's, typewriters, and film projectors 

4. Copy the response tape 

5. Remove all USCONARC materials from the machine 

6. Shutdown the machine, 

d. Equipment malfunction procedure 

If a student reports an apparent malfunction the proctor will: 

1. Note the time of the initial report 

2. Investigate the report 

3. Notify IBM personnel if, in fact, a malfunction exists 

4. Ask the student to take a break (and leave the area) 

5. Ascertain the student's location in the course. 
IBM personnel (one only) will: 

1. Verify that the student has been signed off 

2. Attempt to correct the malfunction. 



B-2 



ERIC 



3. 



If the malfunction cannot be readily corrected, 
(a) Shut down the student station 



(b) Leave the area immediately 

(c) Make necessary arrangements to restore the 
student station as soon as possible 

(d) Complete a comprehensive report describing the 
failure. 

B. 2 Assistance to Students during the Experiment 

a. The proctor will be familiar with the special instructions 
provided for each segment. 

1. Introduction (see Addendum A) 

2« Multimeter (see Addendum B) 

3. Batteries (see Addendum C) 

4. Resistors (see Addendum D\ 

b. The proctor will assist the students in completing the course 
in manner which will result in minimal interference with the 
instructional environment. 

c. If the student has a problem, the * voctor will: 

1. Verify that the student has read all relevant material 

2. Check to see if the difficulty is merely a typing 
problem 

3. Answer student questions as clearly as possible but 
without volunteering information. 

d. The proctor will note each action taken relating to the 
student^ including (see Addendum E): 
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1. 



Student identification 



2. Location within the course material 

3. Nature of request 

4. Nature of action taken 

5. Elapsed time involved. 

e. The proctor will note all unusual activity which does not 

result in communication with the student. (See example of 
Proctor Call. ) 

B. 3 Test Administration 

a. The proctor will 

1. Ask the student to sign off if sign off did not take place 

automatically 

2. Give the student an opportunity to take a break (10 
minutes maximum) 

3. Administer the test in the terminal room with the 
student located away from those still working with the 
course material. 

b. Attitude questionnaires may be administered after the 
student has completed the criterion test. 
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SAMPLE STUDENT CARD 



NAME 
Your Student Number is 



You Are Taking 60 N ACI on Station ^ 

(Course Name) 

Your Appointment Times are: 
Date Day Time 




TO SIGN ON: 

1. Depress the ALTN CODE and INDEX keys at the 
same time. 

2. Type 

"on CCH^^ 

3. Signal enter (ALTN CODE and space bar) 

TO SIGN OI F: 

1. Depress the ALTN CODE and INDEX keys at the 
same time. 

2. Type ^ 

"OFF" * 

3. -Signal enter 
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STUDENT REGISTRATION FORM 

STUDENT APPOINTMENT TIMES 

Thursday Friday 
Number Name Station am pm am pm 

Soli < «-la 4-t 

a»<l5 I 191-4 
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ADDENDUM A 



Proctor Instructions - Introduction Segment 

a. Provide pencil, eraser, ash tray, and paper. 

b. Provide student with exercise board of simple circuit with 
batteries on left-hand side and rheostat on right : set 
rheostat knob so contact is midway between end points and 
open switch. 

When student has completed Introduction segment and begins 
Meters segment, remove board, open switch, and loosen 
one conductor. 
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ADDENDUM B 

Proctor Initructions - Multimeter Segment 

a. The proctor will provide paper, pencil, clean ash triiy, and 
eraser to the student and encourage him to make free use 
of them. 

b. The proctor will set up one multimeter and one set of 
batteries in the area adjacent to the film strip projector: 

1. Set the meter function switch to 20, 000 ohms/v 
DIRECT 

2. Settings of the zero ohms adjust and range switches 
are not critical 

3. Connect the red lead to the 50V jack on the left side of 
the meter 

4. Connect the black lead to the common jack 

5. Set up the batteries with the following connections 

6. Place the exercise board (EB2) on the Uble behind the 
student - unplugged and with fuses removed. 

c. When the student has completed the practical exercise, remove 
the batteries from the station area. 
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ADDENDUM C 



Proctor Instructions - Battery Segnnent 

The proctor will provide paper, pencil, clean ash tray, and 
eraser to the student and encourage him to make free use 
of them. 
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ADDENDUM D 



Proctor Instructions - Resistors Segment 

a. The proctor will check to see that the student has a sufficient 
supply of paper, pencils, clean ash tray, and erasers. 

b. The proctor will supply the student with: 

a. The color slide and encourage him to use it because of . 
poor color reproduction on the slide 

b. The "work sheet" (copy attached) as it is required in 
the practical exercise 

c. The proctor will remove the batteries from the immediate 
area. 

d* Place the exercise board on the table beside the meter 



e. If a student receives the message: 



You missed it again 
Call the Proctor 



The proctor will assist the student in measuring the resistor 
in question; The student will then type in the value obtained. 
(If he is wrong again, the system will provide the correct 
answer. ) 
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V. ORK SHEET 



RESISTOR 



2 
3 



5 
6 
7 
8 
9 

10 



I. VALUE 



II. UPPER 
LIMIT 



III. LOWER 
LIMIT 
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WORK SHEET ' 



RESISTOR 


!• VALUE 


II. UPPER 
UMIT 


III. LOWER 
LINCIT 


1 








2 


VI 






3 






( u 0 


4 








5 




>f ^ Cm 




6 






^3/^ 000 


7 








8 








9 


1 




) 


10 






( , ^S'o, 000 
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ADDENDUM F 

Criterion Test Adminietration Procedures 

1. Give gtudent(8) answer sheet, ash tray, pencil, test booklet 

2. Student will print last name, firsr name, middle initial 

3. Write date 

4. Test Identification is CTI (pretest) or CTII (post test) and 
test booklet number 

5. Student ID is his Army Serial Number. (It is not necessary 
for him to mark sense area. ) 

6. Student should write over cols. 1-4, A, B, C, D, on each 
colxuzm of answers 

7. Tell student - 85 items, 4 alternatives, multiple choice 

8. Show students pictures on page 15 and page 16 

9.. . Tell student - attempt every item, no penalty for guessing 

10. Tell student - select BEST answer to questions 

11. Tell student - do not mark on test booklet 

12. Put start and stop times on answer sheet 

13. Supply student with multimeter TS/352-U (as in Addendum B) 

14. No time limit. 
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COST ANALYSIS 



C- 1 CAI COSTS 

The cost data presented in this analysis includes estimates, since 
tr< available cost data in many instances does not provide directly 
plicable information. In many areas the available data had to be inter- 
preted, extrapolated, and recomputed to provide usable data. There are 
no available data for some cost categories; in some cases, the costs are 
included in other categories and cannot be identified or separated. This 
introduces inconsistencies in the cost data presented and should be so 
rpicognized. 

These data are presented primarily to illustrate the analysis meth- 
ociology and provide an overview of cost relationships. Readers are 
invited to recompute or refine the cost data where there is disagreement 
based on their own criteria. Three alternatives are pi*esented. 

C. 2 COST OF CAI SYSTEM (ALTERNATIVE 1) 

The general procedure for determining costs of the CAI system 
was to identify all costs germane to the installation and operation of an 
IBM 1500 Instructional System at \j, S. Army Signal Center and School 
(USASCS )♦ These cumulative costs were distributed in accordance with 
consistent logical methods to arrive at a representative cost of a CAI 
hour. This cost factor can then be multiplied by the appropriate number 
of instructional hours to compute course costs. This provides a useful 
unit of cost to determine representative CAI cost of multiple situations. 

Z. i CAI Cost Model 

The costs of a proposed IBM 1500 CAI system for bSASCS can be 
grouped into two general classifications: capital investment costs and 
continuing costs. The different computational p rocedures required for 
determining instruction hour costs and the time .f cost accrual logically 
fit into two general classifications. 
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C. 2. Z CAI Capital Investiiient Costs 



CAI capital investment costs for the IBM 1500 Instructional wSys- 
tern are further divided into three categories ol related costs; hardware, 
jribtallHtion, and fav^uitic^ T^:t'Se include all those iter^s re'i^uired to 
provide a CAI system ready for use. Specifically, the hardware cost 
category includes :ill m^^nuXai tared items of the CAI system such as the 
central processing vinit, instructional displays, attachments, controls, 
and associated equi::)nin'nt. The ins. tallraion Lost cau^gory include' J 'Juoh 
Uems as equipn'^ent cnrr^cto"«, oat liiij;, frl-,t- [] -'..ruit^, and <./h<^'r i'enis 
germane to the installation of an IBM I'-iOO Instrxactional System at 
USASCS. The facilities category inv:lvdes tlie cost of new buildings or 
renovation of existing buildings required to house the CAI system. 

Capital investment costs are assets that, in effect, are a collec- 
tion of potential services that will be expended over the following months 
and years. The CAI system, for example, can provide many hours of 
cou* se material instruction for many individuals over a number of years. 
This service can be provided at a relatively uniform rate throughout the 
useful life of the system. It seems logical to distribute the costs of the 
system uniformly to its users over the system's expected useful life. 

The useful life or depreciation schedule will have a major impact 
on the cost per instruction hour and ultimately on the cost of producing 
graduates. An accepted practice in the business cormnunity is to depre- 
ciate data processing equipment over a four to five year period. This 
is done by profit-seeking organizations to achieve a fast write-off of 
capital outlays to expense for obvious tax advantages and as a hedge 
against obsolescence. Are these reasons appropriate to select a four 
to five year depreciation schedule for the IBM 1500 at USASCS? Kop- 
stein and Seidel (1967) suggest a 10-year depreciation period as more 
appropriate for CAI system hardware. CAI costs based on depreciation 
schedules for both five year and ten year periods are provided here 
(Table C-1). 

C. 2. 3 CAI Continuing Costs 

This classification ot costs include those recurring costs that accrue 
with the passage of time and generally require outlays of funds periodi- 
cally* 
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Table C-1 
CAI CAPITAL INVESTMENT COSTS 
IBM 1500 SYSTEM 



'-lardware 

Purchase Rental 

24 Termi- 32 Termi- 24 Termi- 32 Termi- 
nal Sys. nal Sys. nal Sys. nal Sys. 

(Mo. Costs) (Mo. Costs) 



1131 Central Proces- 
cing and Attach- 
ments 

1132 Printer 

1133 Multiplex Con- 
trol + Disk 
Controls 

1442 Card Read Punch 
2310 Disk Drive 
2315 Disk Cartridge 
1502 Station Control 

and Adapters 
1510 Instructional 

Display 
1505 Audio Adapter 

and Drive 
1512 Image Projector 
1518 Typewriter 

029 Keypunch 
2415 Tapedrive and 

Control 
RPQ FXXX Mat. Tape 

Attachment 

TOTAL 



$111,275 
11, 350 



16,875 
14, 575 
31,725 
360 

72, 090 

67,440 

92, 080 
85,440 
b, 260 
12,750 

44, 500 

*25, 000 



$111,275 
1 1, 350 



$ 2, 586 
268 



$ 2,586 
268 



16,875 
14, 57b 
31,725 
360 


375 
265 
705 


375 
265 
705 


77,440 


1,655 


1,780 


89, 920 


1,848 


2,464 


122,430 
113, 920 
6, 260 
12,750 


2, 346 
2, 160 
180 
243 


3, 120 
2,880 
. 180 
243 


44,500 


910 


910 


»:«25,000 


*500 


❖500 


$678. 380 


$14, 041 


$16, 276 




«*519 


**:«519 




$14, 560 


$16,795 



❖ Estimated 

Monthly availability charges (rental) covers the operational use time 
for metered units of the system for 176 hours per month per metered 
unit. Operational use above and beyond this time is subject to "Extra 
Use Charges". 

Note; Prices quoted herein are those currently in effect and are subject to 
change as provided in the IBM/GSA Federal Supply Schedule. 
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Table C-1 (Continued) 

Purchase Rental 



24 Termi- 32 Termi- 24 Termi- 32 Terim- 
nal Sy3. nal Sya. nal Sys. nal Sys. 



Monthly Costs 



Depreciated 5 yrs. $9,862 $11,306 $14,041** $16,276** 
Straight- Line 

Depreciated 10 yrs. 4, 931 5, 653 14,560** 16,795** 
Straight- Line 

Instructional Hour Costs 
Baoed on System Use 

6 hr. /day U8e(5 yr.dep. )$3. 16 $2.71 $4.49 $3.91 

(lOyr.depJ 1.58 1. 36 4.49 3. 91 

12hr/day U8e(5yr.dep. ) 1. 58 1. 36 2. 33 2. 02 

(lOyr.dep.) . 79 .68 2. 33 2. 02 

18 hr /day use (Syr. dep.) 1. 05 .90 1. 55 1. 34 

(lOyr.dep.) . 53 .45 1. 55 1. 34 

* Includes extra charges when used in excess of 176 hr. / month 
** Monthly rental cost, not depreciation costs. 

. Bvuldings and yaclliti»e 

Purcbaso Rental 



24 Termi- 32 Termi- 24 Termi- 32 Termi- 
nal Sys. nal Sys. nal Sys. nal Sys. 

Building and Facili- 
ties Total *$23,000 *$25,000 *$23,000 *$25, 000 
Monthly Costs 
(Amortized 15 yrs. 

Straight-Line) $ 128 $ 139 $ 128 $ 139 

Instructional Hour Costs Based on System Use 

6 hr. /day use $ . 040 $ . 033 $ . 040 $ , 033 

12 hr. /day use .020 . 016 .020 .016 

18 hrs. /day use $ .01'. .OJl .013 .011 

* Eatimatad 00*313 ot tji-iJd i.r.£; .-i i.* ■ .liui;/-';;. fi.ci ,( ..1 ; p',. f ■. <.'d ')y 
l-'ost tnginoer/. Jii'ice, i. '-"l I/.un;-,' uiii, ..'.v.' j'Tsi.y 
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Table C-1 (Continued) 



Installation and Costs* 



Purchase Rental 



24 Termi- 32 Termi- 24 Termi- 32 Termi- 
nal Sys. nalSys. nal Sys. nal Sys. 

Carrels, false floor- 
ing, etc. $12,000 $15,000 $12,000 $15,000 
Station Connectors 2, 000 3,000 2,000 3,000 
Installation Cabling 1,400 1.600 1,400 1,600 
Miscellaneous** 1,200 1,200 1,200 1,200 



TOTAL $16,600 $20,800 $16,600 $20,800 

Monthly Costs 

Depreciated 5 yrs. 

Straight-Line $ 277 $ 347 $ 277 $ 347 

Depreciated 10 yrs. 

Straight-Line $ 138 173 138 173 

Instructional Hour Costs Based on System Use 

6 hr/day use (Syr. dep. ) $ . 088 $ . 083 $ . 088 $ . 083 

(lOyr.dep.) .044 .041 .044 .041 

12hr/day use (Syr. dep. ) . 044 . ^1 . 044 . 041 

(lOyr.dep.) .022 .020 . 022 .020 

•18hr/day use (Syr. dep. ) . 029 • 027 . 029 • 027 

(lOyr.dep.) .014 .013 .014 .013 

»A11 of the Installations cost data presented above are based on e-timates 
since there are no firm plans of the IBM ISOO system physical layout 
available. These data are presented to demonstrate cost model methodology 
and are subject to change as final plans are completed. The variation in 
these data may be significant, and these costs should be recomimted based 
on firm plans when available, 

❖❖Covers unforeseen costs of installation stjch as freight or transportation 
charges and miscellaneous materials and supplies. 



Table C-1 (Continued) 



Estimated Capital Investments Costs Summary 

Options 

Purchase Rental 

24 Termi- 32 Termi- 24 Termi- 32 Termi- 
nal Sys, nal Sys, nal Sys, nalSys, 

Hardware (Total) $59.1,720 $678,380 
Buildings and Facili- 
ties (Total) 23,000 25,000 $23,000 $25,000 
Installation (Total) 16. 600 20,800 16. 600 20,800 
Estimated Start-Up 

Costs $631,320 $724,180 $39,600 $45,800 

Monthly Costs CAI Capital Investments 

Hardware 

Depreciated 5 years $ 9,862 $ 11, 306 $14,041** $16,276** 

Depreciated 10 years 4.931 5.653 14, 560|^ 16,795J^ 

Buildings and Facilities $ 128 $ 139 $ 128 $ • 139 
Installation 

Depreciated 5 years $ 277 $ 347 $ 277 $ 34? 

Depreciated 10 years 138 173 138 173 

Total Monthly Costs 

(5 yr. depreciation) $ 10.267 $ 11.792 $ 14.44b $ 16,762 

(10 yr. depreciation) 5, 197 5. 9b5 14,307 16, 588 

(5 yr. depreciation) $ 14,965 $ 17,281* 

(10 yr. depreciation) $ 14,826* $ 17,107* 

♦Includes extra maintenance cost when metered units use in excess of 
176 hrs/mo. 

❖^Monthly rental costs for ]"vGO Svsto'u, nut depr ocidtiun costs. 
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Table C-1 (Continued) 



Instructional Hour Costs Based on Daily Use 

Purchase Rental 

24 Termi- 32 Termi- 24 Termi- 32 Termi 

nal Sys. nal Sys. nal Sys. nal Sys. 

6 hr/day use (Syr dep) $3. 29 $2. 83 $4. 62 $4. 02 

(lOyr dep) 1.66 1.43 4. 58 3. 98 

12 hr/day use(5yr dep) 1.64 1.42 2. 39 2.07 

(lOyr dep) .83 .72 2. 37 2. 05 

18 hr/day use(5yr dep) 1. 10 . 94 1. 60 1. 38 

(lOyr dep) .55 .48 1. 58 1. 37 
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BEST COPY AVAiUlBLE 



Certain of these costs are incurred in support of each IBM 1500 
Instructional System in operation regardless of how ruany hours per 
day the system is actively used for student instruction. These items 
of cost behave in the s?me way as costs of equipn^eiit dejueciation: 
the greater the utiiizatioxi of the oquipment, the lower the cost per 
student -hour. 

Other categories of continuing costs* will vary directly with tho 
amount of utilizaiiou made of the equipmeul. These continuinu costs 
are basically constant per 6 ludeni-huur of iusUuction pruvxded. 

The four general categories of continuing costs are discu-ssed in 
the following paragraphs and noted in Table C-Z. How each element 
of cost behaves with different patterns of equipments utilization is 
described* 

C. 2. 3. 1 System Maintenance 

This cost category includes the cost of maintaining the hardware 
of the IBM 1500 Instructional System but excludes software or program 
maintenance. The cost data for this category are based on IBM stan- 
dard system maintenance charges currently in effect and are subject 
to change as provided by the LBM/GSA Federal Supply Schedule. Main- 
tenance costs are included in rental charges if this option is selected. 

This cost category represents a fixed cost per instructional sys- 
. tern and does not vary with the extent of usage made of the equipment. 
Hence greater machine utilization reduces the cost of maintenance per 
student hour. 

C. 2. 3. 2 Operations 

This cost categoryincludes system operations costs, electricity, 
cooling, humidity control, and other items pertinent to the day to day 
operation of the IBM 1500 Instructional System. Certain of these costs 
(e. g. , cooling, humidity control) are incurred on a iuli--day basis lor 
each IBM 1500 system largely independent of the amount of usage n^ade 
of the equipment. Other components of these costs (e.g. , electricity, 
personnel acting as computer operators and system proctors) vary 
directly with equipment utilization, Thcbe Lwu types oi cost art segre- 
gated in Table C-?, 
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Table C-2 
CAI CONTINUING COSTS 



Purchase 



24 Terminal 

System 

(Monthly) 



32 Terminal 
Sy item 
(Monthly) 



Rental 



24 Terminal 

System 

(Monthly) 



32 Terminal 

System 

(Monthly) 



Cost Independent of 
System Utilization 

System Maintenance 
Operations 
Overhead k Supplies 
Total 



$1908 
200 
100 

$2208 



$2296 
250 
150 

$2696 



(Included in Rental Chg. ) 



$ 200 
100 
$ 300 



$ 250 
150 
$ 400 



Cost per 6 hour shift 
System Utilization 

Operations 

Software Adaptation & 
Maintenance 
Overhead & Supplies 
Total 



$1240 $1320 

133 200 

300 400 

$1673 $1920 



$1240 $1320 

133 200 

300 400 

$1673 $1920 



Instructional Hour Costs 
Base on System Use 

6 Hr. /day use $ 1.29 

12 Hr. /day use . 92 

18 Hr. /day use . 81 

The above cost data are based on estimates and presented to complete the cost 
model methodology. This cost information should be recomputed based on firm 
plans when available. 



$ 1.15 $ .66 $ .58 

.81 .61 .53 

.70 .59 .51 



C. 2. 3. 3 CAI Program Adaptation and Maintenance 

This category includes the personnel, supplies, and materials 
required to adapt CAI programs to local requirements and the effort 
necessary to modify and update the course material as required. The 
personn^^! r^q'-rl** j»d and b:^^e{ arrcription of their duties are provided 
in Section 4, Applicability, of this report. The size of staff required 
for this functicn depends only on ^he desired level of continuing instruc- 
tional program revision and improvement; it is independent of the num- 
ber of student stations used in the CAI system, since changes to the 
machine-readable programs may be performed under compuL^r control 
once they have been v/rittnr V*; ^.l . I . Uftlonai jjrogr.immcr.o. As a 
result, the charge appearing xn Table C-2 is a prorating of central 
program adaptation and maintenance costs to cne of the several IBM 
1500 Instructional Systems needed to handle the ^otal current in-training 
load for the 26L20 MOS course. 

C* 2. 3. 4 Overhead and Supplies 

This category includes all those prorated costs of a general house- 
keeping nature required to support the effort involved in the three pre- 
ceding categories. As in the case of operations costs, these are divided 
into those which do and do not vary with daily usage of the IBM 1500 
Instructional System* 

C# 2* 3* 5 Continuing Costs Summary 

A summary of CAI continuing costs for the IBM 1500 Instructional 
System is provided in Table C-2. 

When the cost of a CAI system installed in an activity other than 
an ongoing training activity is computed, student pay costs and various 
logistic support costs prorated for the time spent taking instruction could 
be included in this cost category. These costs at USASCS are included 
in the conventional instruction costs but are omitted here. 

If a rental option for the IBM 1500 Instructional System is selected, 
it may be appropriate to include the monthly rental charges as continuing 
costs. However, the rentad option costs are treated as capital investment 
costs in this analysis for reasons of consistency and comparability. 
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C. 2, 4 CAI Program Development Costd 



In analysis of costs ol CAl progran^ development (software), 
i ur categories of costs tend to be logically associated in a model of 
CAI T^rogram Development Costs; 

1. Course n^aterial preparation 

2. Course implementation and debugging 

3. Training aids - supplies and materials 

4. Overhead 

The first two categories, involving functions or tasks and their 
costs, consist of the salary costs of the manpower required to accomplish 
the work. 

Course material preparation for a CAI program requires profes- 
sionals with various academic skills and backgrounds corresponding pri- 
marily to the subject of the course materials under preparation. Generally, 
subject specialists, educational specialists, and course writers are required. 

Review of available salary information discloses a wide salary 
range for the preceding personnel based on education and experience (Table 
C-3). 

Table C-3 

EDUCATION AND SALARY FOR PROFESSIONALS 

Education Average Monthly Salary Range 

0-4 years expen 15 years expen 

y.otx degree * $ 575 $ 830 

BS 735 1000 

MS 875 1250 

PhD 1165 1450 

Course implementation and debugging also involves a group of closely 
related tasks requiring the services of a homogeneous skilled group of people. 
Ihis uroup consists of programmers, coders, analysts, and other data pro- 
cessing personnel needed to take the output from the first group and interface 
it with the CAI system so that the CAI program becomes a useful computer- 
assisted instructional course capable of meeting course objectives. The costs 
of this category will also vary from location to location as well as with edu- 
cational background and experience. Estimated salary ranges for these skills 
are given in Table C-4. 
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Table C-4 

EDUCATI ON AND SALARY FOR DATA PROCESSING PERSONNEL 

Education Average Monthly Sal ary Ran^e 

years_ex£er; 13 years, exper- 

S 640 $ 850 

Non degree ^ ^^qO 

BS 

* 950 

PhD 



1400 

1700 



Also included in the course implementation and debugging cost cate- 
gory is the cost of computer time required to support course development 
One hundred hours of computer time were used during this study. Included 
in this cumulative time were such items as CAI demonstrations tests, and 
the instructional time for the test students. Due to these complicating fac- 
tors, there is no accurate accounting of the amount of computer time used 
specifically for the CAI course development effort. It must be PO^nted out 
that this represents initial effort under development conditions and may 
have very little relation to the computer time required in a production line 
implementation of CAI programs. 

In addition, USASCS provided trial students and other personnel sup- 
port for course validation and other tasks throughout this study No cost 
data is provided for this effort, but such costs should be included xn this 
cost category. 

Training aids (supplies and materials ) include graphic arts, film, 
photography, reproduction, tapes, paper, forms, printing and al other 
materials required for the development of a CAI course. These item 
7^ generally .e identified as direct costs for a specific course of ins trac- 
tion and wiU vary with the needs of the course. For this — ^ 
eory is separated from the overhead cost category. There are little or 
no historical cost data for this category. The cumulative cost for the above 
Usted items for converting the conventional eleven hours and ^^^ ^IsT 
of USASCS couFse 26L20 to CAI course material was $6,890. It must 
be emphasized that these costs represent costs under developmental con- 
ditions and do not necessarily represent production line costs for CAI 
course development. 

The prorated overhead category is included to account for all those 
items o£ cost required to support the CAI program development which 
canaoAe readily identUied w.th . »pecuic course of .,:.,r.=,:o,. to .on,plete 
the model of CAI program dc velop..,..ent co.l.. Tl,e n. 'H.. ..u.-jo, , 
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should include all those costs that canaoL logically be included in the 
preceding categories. 

The cost of CAI program development is a significant considera- 
tion and. depending on the amortization and distribution schedules 
selected, makes a difference in cost of a few cents or dollars per in- 
structional hour. It is axiomatic that the acicounting treatment of 
these costs will have a major impact on the cost-competitiveness of 
the CAI system. 

There is no precedent to provide a basis for selecting an amor- 
tization and distribution schedule. Logically, these schedules would 
vary widely, depending on the utility of the CAI program developed. For 
example, the first six weeks of course 26L20, Microwave Radio Equip- 
ment Repair, is essentially a course in basic electronics. With rela- 
tively minor local adapation this course could be used by all military 
services. With continuous updating as provided in the CAI System cost 
model, the useful life of this course could be extended almost indefinitely 
into the foreseeable future. Thus, there are many logical alternatives 
for amortizing and distributing software development costs for this seg- 
ment of course Z6L20. The other extreme wovild be amortizing and dis- 
tributing the development cost of a highly specialized course of limited 
utility or application. Cost would at first seem prohibitive; however, 
consideration should be given to the ease of updating, storing and in- 
stant availability of the course with little or no start-up costs. When 
a skilled instructor is reassigned, the cost of training a replacement 
is involved or the instructional capability may be lost. A CAI course 
.can be stored and, if updated periodically, retains a ready instructional 
capability. Due to the wide range of possibilities involved in any CAI 
program development cost computation and the very restrictive and 
limited data available in this feasibility study, cost computations have 
been omitted to preclude presenting misleading cost data. In lieu 
thereof, the estimated man-hours required to develop CAI course material 
from 11 hours and 15 minutes of conventional course 2bL20 is presented 
in Table C-5v 

Table C-5 
REQLIRED MAN-HOURS 



Professional Skill 


Man-Hours 


Project Manager 


b4U 


Subject Specialists 


480 


Education Specialists 


640 


Course Authors 


1280 


Prog ramme rs 


1120 


Coders 


480 


Keypunch 


480 


Secretarial 


IbO 


TOTAL 


5280 
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It is estimated that 25% or 1320 hours of this total was spent 
in travel between the site of course preparation and Annapolis and 
Fort Monmouth. Deducting 25% of the preceding total man-hours 
leaves a total of 3960 productive man-hours. 

In retrospect, much of the effort expended would be redirected 
if this effort were undertaken again. Due cognizance of this should be 
taken if cost estimates are computed based on the preceding man-hour 
data. 

Two categories of CAI program costs (software) have been dis- 
cribed: CAI program adaptation and maintenance, and CAI program de- 
velopment costs. At what point do CAI program development costs become 
CAI continuing costs? One approach is to charge all costs of CAI pro- 
gram development to fhe second category until the course objective as 
measured by student criterion test scores is achieved. At this point, 
program development has achieved its objective and can be defined as an op- 
erational course of instruction. Cost of subsequent change or adaptation 
would be a proper charge to the CAI adaptation and maintenance cost 
category. 

C. 2. 5 Summary of CAI System Costs 

After the CAI Instructional Uovr cost for the various classifications 
and categories of cost described in f "AI cost model has been com- 
puted, it is a simple matter to multi, • the Instructional Hour rate by the 
number of hours the student required to complete the course to arrive 
at estimated course costs. As provided for in this cost model, to cal- 
culate the cost of producing course graduates the prorated cost of addit- 
ional training time incurred primarily as a result of attrition and waiting 
must be added to course cost to arrive at the student graduate costs. 
These latter costs provide a useful indication of the overall inefficiency 
of the training process. Adequate control of these costs is essential. 

Table C-6 gives a summary of IBM 1500 CAI system student 
instructional hour costs* 
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Table C-6 



SLMMAKY OF STL DEN T INS Tia C ir-^^^AL HObR COSTS 
~ Range 



Capital Investments (CM) Cost per Stud ent Instructional Hour 

Rental $1.37 to $4. o2 

Purchase . 48 to 3. 29 

Continuing Costs 

Rental $ -51 to $ . 66 

Purchase -70 to 1.29 

Total CAI Costs 



Rental 
Purchase 



$K88 to $5.23 

K18 to 4.58 



NOTE: 1. Data arebased on 24/32 terminal IBM 1500 5/iayear 

depreciation. 

2. CAI program development costs (software) are excluded. 

The following word equations demonstrate the arithmetic of com- 
puting course graduate cost. 

CAI System Instructional Hour Rate x Student Instructional Hour = 

CAI System Course Costs 
CAI Program Development Instructional Hour Rate x Student 

Instructional Hours = CAI Program Development Course Costs 
CAI System Course Costs + CAI Program Development Course Cost = 

Course Costs 

Course costs + A^dditional Training Time Costs = Course Graduate 
Costs (Attrition) 

(Waiting) 

To compute the additional training time costs as a result of attrition 
and waiting time, student time data must be accumulated. This cost 
provides a method of identifying costs of inefficiencies of the instructional 
process and is a useful tool for analyzing performance of the instructional 
process. 

Table C-7 below presents in tabular form a summary of CAI 
system costs. 
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Table C-7 
SUMMARY OF CAI SYSTEM COSTS 



Number of Terminal Systems 

Purchase Rental 

24 Term. 32 Term. 24 Term. 32 Term. 

System System System System 

Total Cost per Instruc- 
tional Hour 



Usage - Deprmaiation 



6 hr/day 


5 yr. 


$ 4.58 


$ 3.98 


$ 5.28 


$ 4. 60 


6 hr/day 


10 yr. 


2.95 


2.58 


5. 24 


4. 56 


12 hr/day 


5 yr. 


2. 56 


2. 23 


3. 00 


2. 60 


12 hr/day 


10 yr. 


1.75 


. 1. 53 


2.98 


2. 58 


18 hr/day 


5 yr. 


1.91 


1.64 


2. 19 


1.89 


18 hr/day 


10 yr. 


1. 36 


1. 18 


2.. 17 


1.88 


ToU ' Cost 


per Course 










26L20 Graduate (840 










Instructional hours) 






















Usage - Depreciation 










6 hr/day 


5 yr. 


$3847 


$3343 


$4435 


$3864 


6 hr/iay 


10 yr. 


2478 


2167 


4402 


3830 


12 hr/day 


5 yr. 


2150 


1873 


2520 


2184 


12 hr/day 


10 yr. 


1470 


1285 


2503 


2167 


18 hr/day 


5 yr. 


1604 


1378 


1840 


1588 


18 hr/day 


10 yr. 


1142 


991 


1823 


1579 



Note: The preceding dummary of CAI System costs do not include CAI 
program development costs. 
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c.3 COSTS OF CONVENTIONAL TRAINING (ALTERNATIVE 2) 

C.3. I General Procedure for Development of Conventional Training 
Costs 

The general procedure for development of conventional training 
costs at USASCS was to identify all cost that could be directly related to 
a specific course of instruction and to distribute this cost proportionally 
to course classroom hours. The common distribution basis of 6 hours 
of instruction in a scheduled 8 -hour day in a 260-schoolday year was 
used consistently with all applicable computations in this analysis. The 
objective was to arrive at a representative cost of the student instruc- 
tional hour. 

Data were accumulated on 45 courses of instruction at USASCS. 
C. 3.2 Conventional Training Cost Model 

Conventional training costs are divided into two general classi- 
fications consistent with the CAI system costs classifications: capital 
investments and continuing costs. The conventional training costs in- 
clude onl> those costs of the training entity at USASCS, Fort Monmouth, 
New Jersey, but exclude any Armywide distribution of overhead or sup- 
port cost. A thorough system analysis of these costs would require con- 
sideration of all costs involved. Also, this report involves implied ser- 
vicewide cost. Due to limited availability of cost data, however, this 
analysis has oeen restricted to the USASCS training environment at Fort . 
Monmouth. 

C. 3. 3 Conventional Training Capital Investment Costs 
C. 3.3. 1 Facilities and Installations 

The facilities and installations at USASCS used for training 
activities, faculty, and student body can be grouped into three general types 
of buildings: permanent, semi-permanent, and temporary. As the 
Fort Monmouth Post Engineers Office reported, permanent buildings are 
amortized straight-line over 25 years. Semi-permanent and temporary 
buildings are amortized over 15 years. These buildings are amortized at 
cost in accordance with generally accepted accounting conventions. The 
Fort Monmouth Post Engineers Office reports the total cost of USASCS 
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buildings as $8, 388, 598. This is conservative, since replacement costs 
are estimated at approximately $36, 000, 000. World War II temporary 
buildings are not included in this cost, since they have exceeded their 
amortization life, but the renovation and upkeep costs are included in the 
operations and maintenance costs. These building costs were amortized 
in accordance with the recommended amortization period and distributed 
proportionally to student classroom hours. 

C. 3. 3* 2 Capital Equipment 

This cost category should include all costs of capital equipment 
used by USASCS (e.g. , radar, radios, test equipment, and other ex* 
pensive equipment requiring large outlays of capital). Most of this equip- 
ment is included in the operations and maintenance cost and could not be 
separated from these data. One item listed in this category, the AN/ MSG- 
46 satellite communications (Radome Disk), vJ^as depreciated over 15 
years at a cost of $2, 000, 000 and distributed to student instructional hours. 

The conventional training capital investment cost per student in- 
structional hour is computed as $. 042. This is considered a very con- 
servative estimate and not a significant cost factor (Table C-8). 
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Table C-8 
CAPITAL INVESTMENT COSTS 



Facilities and Installations 
Permanent Building Total 

Amortized 25 yrs. straight-line, monthly costs 
Semi-Permanent Buildings Total 
Amortized 15 yrs. straight-line, monthly costs 
Temporary Buildings Total 

Amortized 15 yrs. straight-line, monthly costs 



$7, 622,334 
25, 408 
331, 064 
1»839 
435, 200 
2, 418 



Capital Equipment 
Radome Dish total 

Amortized 15 yrs. straight-line, monthly costs 
Total Monthly Amortized Costs 



$2, 000, 000 
11, 111 

$40,776 



Instructional Hour Cost 

$. 042 student 

$40, 776 (Total Monthly Amortized Costs) « instructional 

7419 (Avg. student in training x 21. 7 (school days x 6 hrs/day hour costs 
Jan-July 1967) per month) 

Course 26L20 Mean 45 Courses 
Facilities and Installations Course Costs $35 $23 
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C« 3. 3. 3 ConventionajL Training Continuing Costs 

This classification includes two broad categories of costs: 
Operations and Maintenance, Army Appropriation Costs (O & M, A), 
and Military Personnel Costs (Mil Pers). 

C. 3, 3, 4 Operations and Maintenance, Army Appropriations 

USASCS completed a detailed analysis of the O & M, A cost 
of various courses at USASCS in early summer, 1967. The daU on 
45 courses are used in this analysis. The O & M, A costs are further 
grouped into mission costs and base operations costs. 

Mission costs include primarily all those costs that can be re- 
lated directly to a specific course. These costs were then distributed 
to instructional hours of that course. Those costs not directly related 
to a specific course were distributed proportionally to all courses and 
instructional hours. 



C« 3. 3. 5 Base Operations Costs 

This category, formerly known as operations and maintenance of 
facilities (OMF), includes those costs of operating Fort Monmouth in 
support of tenant activities. The identified costs were distributed pro- 
portionally over all courses and instructional hours. 

A summary of O & M, A cost of producing student graduates per 
instructional hour is given in Table C-9* 

Table C-9 

STUDENT INSTRUCTIONAL HOUR COSTS 

Range $1. 14 to $6. 69 

Course 26L20 $1. 52 

Mean of 45 courses $2. 18 

The above costs, the instructional hour costs of producing course 
graduates, include the costs of additional training time distributed to 
course graduates. Data on additional training costs due to attrition and 
waiting time was not available, and these costs could not be separated. 

Table C-10 below is a summary of O&M, A costs applicable to 
courses of instruction at USASCS, 
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Table C- 10 

OPERATIONS AND MAINTENANCE, ARMY APPROPRIATION (O & M, A) 



Mission Costs 



Items 

Civilian Instructor 
Training Aids 
Supplies and Materials 
Overhead 

Total Mission Costs 



Course 26L20 Mean 45 Courses 



$ 218 
6 
52 
300 



$ 576 



$ 325 
31 
110 
282 



$ 748 



Base Operations Costs 



Item 



Renovation $ 10 

Repair* Utilities, Janitorial 307 
Services 

Headquarters Services 
Recreation and Welfare Services 
Maintenance Services 
Communications and Pictorial Services 
Transportation Services 
Unidentified Costs (Prorated) 

$ 701 

Total O & M, A Costs $ 1, 277 

Instructional Hours Costs $ 1. 52 



193 
11 
53 
7 

14 
106 



$ 7 

203 

128 
7 
35 
5 
10 
70 



$ 465 
$ 1, 213 
$ 2. 18 



The length of course 26L20 is 28 weeks or 840 hours of instruc- 
tion, based on six hours per instructional day. The average for 45 
courses at USASCS is 18. 5 weeks or 556 hours cf instruction. 
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C.3.3.6 Military Personnel Costs (MU Pers) 



Military Personnel costs are based on planning figures rather 
than a precise analysis of each pay account involved. The military pay 
factors used in computing military personnel costs were the group pay 
rates, as set forth in AR 37-29 as amended by Army message 142005Z 
of July 1967 (Subject: accounting and reporting for the cost of military 
personnel services). The data on personnel numbers and pay grades was 
obtained from the USASCS Personnel and Registrar Offices. 

C. 3. 3. 7 Categories of Mil Pers Costs 

Three categories of Mil Pers costs are computed: military in- 
structor, student pay, and military staff and other assigned personnel. 
Military instructor is a separate cost category, since this category 
along with civilian instructor costs would most likely be redistributed 
with the use of a CAI system. Student pay, the major cost category in 
this classification of costs, is identified for analytical purposes. MiliUry 
Staff and other assigned personnel represent those military personnel at 
USASCS required to support the training activities. 

The general procedure for computing these costs was to deter- 
mine the mean monthly population by pay grade at Fort Monmouth for 
January through July 1967 and multiply by the applicable monthly pay 
grade rate. The monthly cost was then distributed to the monthly student 
instructional hours. 

This procedure does not take into consideration variations in 
instructional time as a result of student attrition, student recirculation, 
and student waiting time. If has been estimated that Mil Pers costs of 
the student graduate may be increased by as much as 5% by these factors. 
However, there are no reliable data, on the variation in instructional 
time as a result of these factors, on which to compute adjustments. 
Although these adjustments may increase the conventional costs, they 
will not significantly affect the cost -comparisons and have been omitted 
in keeping with the conservative estimates of conventional training. 

Table C-.ll below presents' in detail calculations supporting 
estimates of military personnel costs. 
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Table C-U 
MILITARY PERSONNEL COSTS 



Student Pay and Allowances 
Average Student Population (January through July 1967) 



Pay Grade 


Number 


Costs 


E-2 


5765 


$ 1, 25 1, 005 


E-3 


1038 


225, 246 


E-4 


220 


98,340 


E-5 


253 


113, 091 


E-6 


120 


53, 640 


E-7 


21 


16,372 


E-8 


2 


1,464 


TOTAL 


7419 


1, 758, 158 



Distribution 



$1, 758, 158 (Student pay and allowances) _ 

7419 X 21. 7 days/month X 6 hrs. /day 

Cost per student hour: $1.82 

Course 26L20 Mean of 45 Courses 

Student Pay and Allow- $1529* $1012* 
ances Cost per Course 

♦ Rounded to even dollar cost 

Military Instructors 
Average - (January through July 1967) 



Pay Grade 



Number Costfl 



W1-W4 10 $ 7,430 

E-9 7 5, 124 

E-8 43 31,476 

E-7 538 393,816 

E-6 1087 485,889 

E.5 5 2, 235 

TOTAL 1814 925,970 
D istribution 

$925, 970 (Military Instructors) _ ^ 

7419 X 21. 7 (school days/month x 6 hrs. / day) 

Cost per student hour: ^^^^^^ 26L20 Med'Shs Courses 

Military Instructor Cost 

per Course $806'".' $534':' 



'I'Rounded to even dollar cos_ts__ 




Table C-li (Continued) 



Military Staff and Other Assigned Military Persozmel 
Average - (January through July 1967) 



Pay Qrade 


Number 


Costs 




1 


$ ^, 064 


Oo 


1 1 


14, 333 


05 


36 


46, 908 


AA 




54, 726 






40, od5 


A O 

0 L 


27 


20, 061 




.8 


5, 944 




8 


5, 856 


XT' O 


34 


Z4, 888 


E-7 


52 


38, 064 


£-6 


83 


37, 101 


£-5 


229 


102, 363 


£-4 


176 


78, 672 


E1-E3 


176 


38, 192 


TOTAL 


936 


$ 510,037 



Diitribution 

$510, 037 (Military itaff and other assigned personnel) 
7419 X 21. 7 ( school day/month x 6 (hrs. /day) 

Cost per student hour: 

Course 26L20 

Military Staff and Other $4454( 
Assigned Personnel Cost per Course 

^Rounded to even dollar cost 



A summary of average military personnel costs per student 
instructional hour is as follows: 



Student Pay $1.82 

Military Instructor Pay .96 

Military Staff and Other . 53 

TOTAL $3.31 



$.53 

Mean of 45 Courses 

$295* 
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NOTE- Military Personnel costs were developed using pay-grade group 
rates in accordance with AR37-29 as amended by Army message 
R142005Z of July 1967, subject: Accounting and Reporting for 
the cost of Military Personnel Services. ttcaqp^; 
Data on numbers of students were obtained from the USASCS 
Registrar's office and data on number of military staff and 
other assigned personnel were provided by the USASCS per- 
sonnel office. 

C. 3. 4 Conventional Instruction Course Development Cost 

This classification of conventional instruction cost is defined for 
comparative purpose, and for completion of the cost analysis methodology, 
siTZ the cosis are comparable to CAI program development cos s. No 

are collected on this cost classification. Some of these ar n- 

eluded in the cost data for conventional training data (O & ^ * and m^li 
tary personnel costs). Cost items such as curriculum f-;l°P"!."' "f^,, 
ralnLg material preparation are examples of the effort at USASCS wh^ch 
would be included in this category but cannot be separated from the avail 
able cost data. 

Also, development of training materials or literature (e. g. , train- 
ing fUms and technical manuals) used by USASCS but f "^"P^^^^'^'ata 
uIaSCS involves costs. These items, not included in USASCS cost data, 
ar^f "need from other sources but should be included in this cost category 
for comparative purposes. 

' C. 3. 4. 1 Course Material Preparation 

This cost category involves the concerted effort of professional per- 
onne. (e g course waiters, subjecr specialists and education specialists) 
Is^eauir'ed o prepare the outline, objectives, and informational material 
for development of'a new conventional course of instruction. Costs include 
salaries of the employees involved in this effort. 

C. 3. 4. 2 Editing and Reviewing 

This cost category also involves the joint effort P"»°°; ^ 
professional level somewhat different from those required for course 
material preparation. 

It may be appropriate to combine this category with the pre- 
ceding category, but'f or 'comparison purposes it is identified separately 
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since a definite parallel with. the cost categories of CAI program develop- 
ment exists. The costs of this category are the salaries of the employees, 

C,3,4,3 Illustrations - Supplies and Materials 

This category includes the costs of the graphic arts, training 
aids, printing, reproduction, paper, typing, and similar items required 
in developing a new course of instruction. These costs apparently vary 
widely, depending primarily upon the course being developed, A com- 
parable cost category is included in the CAI program development model, 
and similar variations in cost are to be expected. 

C. 3. 4. 4 Prorated ^>v'erhead 

To complete the cost model and include all costs, the prorated 
overhead cost required to support the course development effort must 
be included. This includes housekeeping and logistic support necessities, 
such as a prorated share of those items included in the base operations 
(O & M, A) costs at Fort Monmouth. 

The amortization and distribution of conventional course develop- 
ment costs will have an impact on conventional training similar to their 
effect on CAI program development costs, 

C^ 3.4. 5 Summary of Conventional Training Costs 

The summary of conventional training cost of producing course 
graduates per student instructional hour is given in Table C-12, 



Table C-12 
STUDENT INSTRUCTIONAL HOUR COSTS 



Cost Type 

Capital Investments 

Facilities and Installations 
Capital Equipment 



Course 
26L20 



$ .03 
.01 



Mean of 45 
Courses 



$ .03 
.01 



Continuing Costs 

O b M. A 
Mil Pers 



1.52 
3. 31 



2. 18 

3. 31 



Total Instructional Hour Costs 



$ 4. 87 



$ 5.53 



Range of Total Instructional Hour Costs for 45 Courses 

$ 4. 76 to $ 10.03 
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C.4 COMBINING CONVENTIONAL TRAINING AND CAI SYSTEM 
(ALTERNATIVE 3) 



Installation of an IBM 1500 Instructional System at USASCS intro- . 
duces a new training system into an on-going conventional training en- 
vironment. The cost of producing course graduates then becomes a 
combination of the cost of the CAI system and the modified costs of the 
on-going conventional training. 

The cost category in the conventional training environment which 
CAI may most reasonably be expected to reduce is the category of 
instruction (both military and civilian) costs. This reduction would be 
brought about not by a reduction in manpower level, but by a shift in the 
roles played by the same men. Specifically, instructors used in the 
classroom and to support classroom activities would, with CAI, shift 
their duties to proctoring the CAI system and operating the computers. 
The cost figures presented in this analysis show military and instruc- 
tor costs reduced by a conservative estimate of 50% and the costs of 
CAI system proctoring and computer operation included in the category 
••CAI Costs''* The instructor remaining with the CAI system would be 
used not in the conventional manner, but for individ\xal student coun- 
seling in support of student use of the CAI system. 

The shifting of what were instructor costs for the conventional 
training environment into proctoring and computer operating CAI costs 
does not itself lead to the economies in the conventional training en- 

m 

vironment which justify the CAI system. These economies come pri- 
marily from one of the major comparative strengths of the CAI method 
of instruction: its demonstrated ability to increase the efficiency of the 
instructional process through reduction of total training time. When 
total training time required per course graduate is reduced, all cost 
categories (whether they are present in the original conventional train- 
ing environment or arise directly from use of the CAI system tself) are 
reduced proportionately. 

Table C-13 illustrates these points. Comparison of the leftmost 
two columns shows, vmder the condition of no change in total instruc- 
tional time, how CAI may be expected to reduce conventional military 
and civilian instructor costs, and also shows the more -than-off setting 
additional cost of the CAI system. The third column, however, shows 
the CAI instructional costs fall with the anticipated decrease in instruc- 
tional time. Comparison of the rightmost column with the conventional 



C-28 



Table C-13 

COMPARATIVE COST OF PRODUCING A COURSE GRADUATE 



Fort Monmouth Course 26L20 Costs 



Conv. 



Mil Instructor 

(MilPers) $ 806 

Civ. Instructor 

(0&M,A) 218 
Mission (O & M,A) 358 
Base Ops (0&M,A) 701 
Mil Staff (Mil Pers) 445 
Student Pay 

(MilPers) $1,529 
Facilities and 

Installation 35 



Total Conv Costs $4, 092 



CAI Costs 



CAI - Conv* Costs Connbined 
Instructional Time 



No Reduction 

$ 403 

109 
358 
701 
445 

1,529 
35 

$:»580 
1. 142 



20% Reduction 



$ 322 

87 
286 
561 
356 

1,223 

28 



$2,863 
914 



Total Grad Costs $4, 092 



$4,722 



$3,777 



NOTE: The CAI cost data is based on a 24 termi- 
*tal IBM 1500 Instructional System used for 18 
instructional hours a day 5 days a week and de- 
preciated over 10 years straight-line. 



cos^«» shows that, with a 20% reduction in instructional time, total 
costs under CAI are lower (by $315) than th<? original conventional 
costs. This illustrates the general principle that savings in 
inst-uctional time obtainable with CAI will more than offset the 
additional costs of the CAI equipment and lead to a net reduction in 
total training costs per course graduate. 

11 the instructional effectiveness of course material is consider- 
ed In addition to economies, the best teaching strategy might well be 
a combination of convertional instruction used for some lessons and 
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CAIused for others* Within those lessons in which CAI is used, 
however, instructional time will still be reduced and the same 
relative economic advantage of CAI obtained. With a mixed in- 
structional strategy such as this, total costs per course graduate 
may be estimated by applying conventional instruction hourly rates 
to those hours taught conventionally, and applying the correspond- 
ing CAI rates to those hours taught by CAI, provided tijat student 
scheduling is performed in such a manner as to allow realization 
of time savings through CAI. 

It should be noted that the cost comparisons provided in Table 
C-13 are based upon the selection of the CAI Instructional System 
configuration and usage referred to in the note to that table. Tables 
C-14 through C-17 provide in detail equivalent comparisons based 
upon other possible selections of system configuration and usage# 

Figure C-1 illustrates graphically how the cost comparisons 
are related to savings in instructional time for selected alternatives 
in these tables. 
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CAI ALTERNATIVE 



Total Cost per 
26L20 Graduote 



CP/c 



Rental or Purchose 
R or P 



10% . 20% 

Reduction In Instruction Time 




Deprec iot ion Yeors 

H oura Us»/Day j 



10 



12 



12 



10 



10 



18 



18 



77 



18 



30% 



Fi^tire C-l. Comparison of Convpntionil and CAI Costs 

for 32-Station IBM 1=^00 I istructional System- 

■Costs for 21-.Station IBM ISOO are about SlBO-'lOO per Graduate 
higher than equivalent costs for 32-Station IBM l=iOO. 

C- ^, 1 
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Table C-14 

COMPARATIVE COURSE GRADUATE COSTS 
CONVENTIONAL VS CAI COURSE 26L20 



Purchase Option 



COST CATEGORY 
Conventional Instruction 
Costs 



Military Instructors 
Civilian Instructors 
Mission 

Base Operations 
Military Staff & Other 
Assigned Personnel 
Student Pay 

Facilities b Installations 



IBM 1500 System Purchase Option - 

5 Year Depreciation (Hardware)* 

Conven- 
tional 

Instruc- CAI 
tion** None*** 



$ 



806 
218 
358 
701 

445 
1,529 
35 



$ 



403 
109 
358 
701 

445 
1, 529 
35 



Total Conventional Costs $4. 092 $3. 580 



CAI IBM ISOO 24 Stations 
6 hrs. use/ school .day 
12 hrs. use /school day 
18 hjri.xM«/ school day 

ToU Courso Co sis /Student 
6 hrs. CAI use/ school day 
12 hra, CAI use /school day 
18 hrs. CAI use/ school day 



CAI IBM 1500 32 Stations 

b hrs, use/ school day 
12 hrs, use/school day 
18 hrs. use/school day 

Tot. Course Costs / Student. 
6 hrs. CAI use/ school day 
12 hrs. CAI use/ school day 
18 hrs. CAI use/ school day 



$3, 847 
2, 150 
1,604 



$7,427 

5, 730 
5, 184 



$3, 343 

1, 873 
1, 378 



$6,923 
5,453 
4, 958 



r" AT 


C AT 


r AT 


10%*** 


20%*** 


30%*** 


$ 363 


$ 322 


$ 282 


98 


87 


76 


322 


286 


251 


631 


561 


491 


401 


356 


312 


1, 376 


1, 223 


1, 070 


32 


28- 


25 


S3. 223 


$2. 863 


$2. 507 



$3,462 $3,078 $2,693 



1,935 
1,444 



$6, 685 

5, 158 
4, 667 



$3, 009 
1, 686 
1, 240 



$6, 2i2 
4, 909 
4,463 



1, 720 
1, 284 



$5, 941 

4, 583 
4, 147 



$2, 675 
1, 499 
1, 102 



$5, 538 
4, 362 
3, 965 



1, 505 
1, 123 



$5, 200 

4, 012 
3, 630 



$2, 340 
1, 311 
964 



$4, 847 
3, 818 
3,471 



■ * Capital Investments in the IBM 1500 System Hardware are Depreciated 

Over 5 years . , , , 
** The initial 50% reduction in conventional instructor cost is includert m 
the CAI costs under tne CAI continuing cost classification as proctors 
and computer operators. 
• Reduction Instruction Time 
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Table C-15 

COMPARATIVE COURSE GRADUATE COSTS 
CONVENTIONAL VS CAI COURSE 26L20 



COST CATEGORY 
Conventional Instruction 
Costs 

Military Instructors 
Civilian Instructors 
Mission 

Base Operations 
Military Staff & Other 
Assigned Personnel 
Student Pay 

Facilities & Installations 



Conven- 
tional 
Instruc- 

tion*>!- 



IBM 1500 System Rental Option - 6 Year 
Depreciation (Installation Costs)* 



CAI 



CAI 



CAI 



CAI 



$ 



806 
218 
358 
701 

445 
1.529 
35 



Total Conventional Costs $4, 092 

CAI IBM 1500 24 Stations 

6 hrs. use/school day 
12 hrs. use/school day 
18 hrs. use/school day 

Tot* Course Costs/Studen t 

6 hrs. CAI use/school day 
12 hrs. CAI use/school day 
18 hrs. CAI use/school day 

CAI IBM 1500 32 Stations 

6 hrs. use/school day 
12 hrs. use/school day 
18 hrs. use/school day 

Tot. Course Costs/Student 
6 hrs. CAI use/school day 

12 hrs. CAI use/school day 

13 hrs, CAI use/school day 

IBM 15tfO System Installation Costs are depreciated over 5 years. 
The initial 50% reduction in conventional instructor cost is included 
in the CAI costs under the CAI continuing cost classification as 
proctors and computer operators. 

Reduction Instruction Time. 





1 0%**>!t 


20%*** 


30%*** 


4; 40*) 




$ 322 


$ 282 




Q& 


o7 


76 


358 


322 


286 


251 


701 


631 


561 


491 


445 


401 


356 

<j ^ \j 




1,529 


1. 376 


1,223 


1, 070 






28 


25 




<t o o o ^ 

$3, 223 


$2, 863 


$2, 507 




$3, 992 


$3, 548 


$3, 105 


2, 520 


2, 268 


2, 016 


1,764 


1, 840 


1,656 


1,472 


1, 288 


$8, 015 


$7,215 


$6,411 


$5,612 


6, 100 


5,491 


4, 879 


4,271 


5,420 


4,879 


4, 335 


3,795 


$3, 864 


$3,478 


$i, 091 


$2, 705 


2, 184 


1,966 


1,747 


1,529 


1, 588 


1,429 


1, 270 


1, 111 


$7,444 


$6, 701 


$5, 954 


$5, 212 


5,764 


5, 189 


4, 610 


4, 036 


5, 16d 


4, 652 


4, 133 


3, 618 
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Table C-16 

COMPARATIVE COURSE GRADUATE COSTS 
CONVENTIONAL VS CAI COURSE 26L20 

Purchase Option 

IBM 1500 System Purchase Option - 

10 Year Depreciation (Hardware)* 

COST CATEGORY Conven- 
Conventional Instruction tional 



Costs Instruc- 


CAI 


CAI 


CAI 


CAI 


tion** 


None*** 


10%*** 


20%*** 


30%*** 


Military Instructors $ 


806 


$ 403 


$ 363 


$ 322 


$ 282 


Civilian Instructors 


218 


109 


98 


87 


76 


Mission 


358 


358 


322 


286 


251 


Base Operations 


701 


7n 1 

f U 1 


A'^ 1 


^ U 1 


4Q1 


Military Staff & Other 








356 
>j ^ \j 


312 


Assigned Personnel 


445 




401 


Student Pay 


1, 529 


1, 529 


1, 376 


1, 223 


1, 070 


Facilities & Installations 


35 


35 


32 


28 


25 


Total Conventional Costs $4, 092 


$3, 580 


$3, 223 


$2,863 


$2| 507 


CAI IBM 1500 24 Stations 












6 hrs« use/school day 




$2,478 


$2, 230 


$1, 982 


$1,735 


12 hrs. use/school day 




1, 470 


1, 323 


1, 176 


1,029 


18 hrs. use/school day 




1, 142 


1, 028 


914 


800 


ToU Costs /Graduate 












6 hrs« CAI use/ school day 




$6, 058 


$5,453 


$4, 84 J 


$4, 242 


12 hrs.CAI use/school day 




5, 05D 


4, 546 


4, 039 


3, 536 


18 hrs. CAI use/school day 




4, 722 


4,251 


3, 777 


3, 307 


CAI IBM 1500 32 Stations 












6 hrs. use/school day 




$2, 167 


$1. 950 


$1, 734 


$1, 517 


12 hrs. use/school day 




1, 285 


1, 157 


1, 028 


. 900 


18 hrs. use/school day 




go; 


892 


793 


694 


Tot. Costs /Graduate 












6 hrs. CAI use/school day 




$5, 747 


$5, 173 


$4, 597 


$4, 024 


12 hrs. CAI use/ school day 




4, 865 


4, 380 


3, 891 


3,407 


18>hrs.CAI use /school day 




4, 571 


4, 115 


3, 656 


3, 201 



* Capital investments in the IBM 1500 System Hr rdware are depreciated' 
over 10 years. 

** The initial 50% reduction in conventional instructor cost is included in 
the CAI costs under tho CAI continuing cost classification as proctors 
and computer ope* ators. 
*-** Reduction Instruction Time. 
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Table C-17 

COMPARATIVE COURSE GRADUATE COSTS 
CONVENTIONAL VS CAI COURSE 26L20 



Rental Option 

IBM 1500 Rental Option - 10 Year 
Depreciation (Installation Costs)* 
COST CATEGORY Conven- 



Conventional Instruction tional 










Costs Instruc- 


CAI 


CAI 


CAI 


CAI 


tion** 


None*** 


10%*** 


20%*** 


30%*** 


Military Instructors $ 806 


$ 403 


$ 363 


$ 322 


$ 282 


Civilian Instructors 218 


109 


98 


87 


mm / 

76 


Mission 358 


358 


111 

322 


1 o z 

286 


251 


Base Operations 701 


701 


631 


561 


491 


Military Staff & Other 










Assigned Personnel 445 


445 


401 


356 


312 


Student Pay 1, 529 


1, 529 


1, 376 


1,223 


1,070 


Facilities & Installations 35 


35 


32 


28 


25 


Total Conventional Costs $4, 092 


$3, 580 


$3, 223 


$2,863 


$2, 507 


CAI IBM 1500 24 Stations 










6 hr8« use/school day 


$4. 402 


$3. 962 


$3, 521 


$3. 081 


12 hrs* use/school day 


2, 503 


2, 253 


2, 003 


1,752 


18 hrs. use/ school day 


1, 823 


1,641 


1,458 


1,276 


Tot* Course Costs/Student 










6 hrs*CAI use/school day 


$7. 982 


$7. 185 


$6. 384 


$5. 588 


12 hrs* CAI use/ school day 


6. 083 


5,476 


4, 866 


4, 259 


18 hrs* CAI use/ school day 


5,403 


4,864 


4, 321 


3,783 


CAI IBM 1500 32 Stations 










6 hrs* use/school day 


$3, 830 


$3,447. 


$3, 064 


$2, 681 


12 hrs* use/school day 


2, 167 


1,950 


1, 734 


1,517 


18 hrs* use/school day 


1,579 


1,421 


1, 263 


1, 105 


Tot* Course Costs/Student 










6 hrs.CAI use/school day 


$7,410 


$6,670 


$5,927 


$5, 188 


12 hrs.CAI use/school day 


5, 747 


5, 173 


4,597 


4. 024 


18 hrs.CAI use/school day 


5, 159 


4, 644 


4, 126 


3, 612 



* IBM 1500 System Installation Costs are depreciated over 10 years* 
** The initial 50% reduction in conventional instructor cost is included 
in the CAI costs under the CAI continuing cost classification as 
proctors and computer operators. 

*** Reduction Instruction Time. 
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